Alrick Dbritto
Senior Data Engineer
Mumbai
Summary
Data Enthusiast , bringing in my expertise in ETL and diverse experience in multi cloud applications on AWS and Azure.
Experienced in multiple Data Driven Applications and platforms for Analytical purpose. Data modelling , Data Warehousing , Delta lake creation. Reliable Data Engineer with Healthcare industry experience. Offers excellent communication and good judgment to effectively meet team needs. Proactive planner and problem solver.
Overview
8
8
years of professional experience
4
4
Certifications
4
4
Languages
Work History
Senior Data Engineer
Abbott Healthcare Pvt Ltd
Mumbai
12.2021 - Current
- Working closely with the stakeholders & solution architects ensuring architecture meets the business requirements
- Creating a complete solution by integrating a variety of programming languages & tools together taking care of the complete ETL process
- Big Data and Advanced Analytics team developed a framework on python to bring the Diagnostic data from machine directly to cloud datalake
- Streaming data processed every hour which more than 800 pipelines running parallely with data being loaded to delta tables with an average data load of 100 Tb's of per month
- Extensive capabilities showcased on Databricks jobs and pipelines, clustering and monitoring the load, maintaining audit for the data, all on AWS cloud
- Medical devices data loaded every month on Azure data lake delta tables, performing and maintaining pipelines on Azure native Databricks
- Managed team to perform several POC's and productionizing several pipelines on Azure.
- Worked successfully under Agile methodologies to deliver on-time projects.
Data Engineer , Consultant
Deloitte USI
Mumbai
03.2020 - 11.2021
- ETL end to end implementation on migrating conventional systems like Oracle from on-premise to Azure Data Lake, Azure Synapse using ADF Incremental pipelines for daily consumer transactional data for several periods
- Data Modelling, transactional stored procedures were created using Azure Synapse and executed using Azure Data Factory pipelines triggered from Automated Tivoli Jobs
- Data cleansing was handled using Python scripts for different files and delimiter's
- Developed Informatica cloud pipelines to Extract Data from Source Servers.
- Analysed data and information to identify issues and create tailored solutions.
Software Engineer
Atos Global IT Solutions
Mumbai
06.2016 - 03.2020
- Extract, Transform, and Load data into Azure HDinsight by implementing incremental data pipelines from Azure Blob Storage using Azure Data Factory
- Develop Spark .py scripts for transformations on the data in HDinsight using DataFactory Spark activity optimizing memory, executors, core's used in spark job using spark script
- Used spark-cosmos Db-Azure connectors in Spark script for Bulk data transfer into cosmosDB
- Deploy , Config , and Maintain Compute on Azure Cloud automate deployments and troubleshoot mechanisms for quick service
- Monitor and implement Azure native services for cloud administration
- Developed microservices using Python flask for deploying the models developed on Azure container service(AKS)
- Scheduling and automating pipelines for deploying the ML models on Azure container Service as an Rest Endpoint using Azure devops.
Education
Bachelor of Technology - Computer Science
Fr . Conceicao Rodrigues College of Engineering
Diploma of Higher Education - Computer Technology
Directorate of Technical Education
IndiaSkills
PySpark
Agile methodology
AWS cloud
Solutions deployment
Azure cloud
Databricks
Bigdata
Streaming Solutions
Certification
Dp - 200 Azure Data Engineer Associate
Timeline
Senior Data Engineer
Abbott Healthcare Pvt Ltd
12.2021 - Current
Data Engineer , Consultant
Deloitte USI
03.2020 - 11.2021
Software Engineer
Atos Global IT Solutions
06.2016 - 03.2020
Bachelor of Technology - Computer Science
Fr . Conceicao Rodrigues College of Engineering
Diploma of Higher Education - Computer Technology
Directorate of Technical Education