Abhishek Sharma

Data Engineer

Project: KraftHeinz

• Successfully led the migration of data from Azure Data Factory to Dagster Cloud Platform, ensuring smooth transition and optimizing data flow efficiency.
• Designed and implemented robust ETL/ELT pipelines to efficiently extract, transform, and load data from various sources into target systems, ensuring data accuracy and consistency.
• Implemented comprehensive end-to-end data validation processes to ensure data integrity, consistency, and accuracy throughout the entire data pipeline.
• Developed Python scripts for extracting data from web services API's such as Amazon Vendor APIs, Nielson APIs etc. and loading into databases.
• Developed automated ingestion monitoring jobs to track data ingestion processes, ensuring timely detection and resolution of any failures, thereby maintaining data pipeline reliability and performance.
• Created custom Python handlers to support data ingestion from Excel files, incorporating specialized conditions handling to accommodate diverse data formats.
• Developed Python export jobs to efficiently deliver data to users, utilizing customizable parameters and formats to meet user preferences.
• Optimized data models to enhance query performance, improve data integrity, and minimize storage.
• Resolved failed jobs promptly to minimize downtime and ensure continuous data pipeline operations, leveraging troubleshooting skills and proactive monitoring techniques.

Project: Southern California Edison

• Worked closely with the team to provide support for data related issues.
• Collaborated extensively with business stakeholders and other cross-functional teams in sprint planning, user story refinement and backlog prioritization.
• Testing the Data Models ensuring the consistency in the data.
• Fetching the reports from SAP and modifying it in order to ingest it to Snowflake.

• Worked as a Full Stack Developer with majorly working on Golang and VueJS.
• Developed code in Golang to scrape data from the websites and feeding the data to front end.
• Created some of the components of UI using VueJS.