Abhishek Sapre
Pune
Summary
Working professional with over 9+ years of experience, with 6 years' experience in designing, developing, and managing data solutions on Microsoft Azure. Proficient in data ware housing, ETL processes, and big data technologies, with a focus on delivering scalable data architecture. Experienced in collaborating with cross functional teams to drive data driven decision making and insights. Proven track record of optimizing data pipe lines and ensuring data integrity, security, and performance. Insightful Senior Data Engineer known for high productivity and efficiency in task completion. Possess specialized skills in data modeling, ETL development, and cloud computing solutions. Excel in problem-solving, teamwork, and communication, ensuring successful project outcomes and effective collaboration with cross-functional teams.
Overview
9
9
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Systems Plus Pvt. Ltd.
Pune
01.2025 - Current
- Designed data pipelines to streamline data processing and integration.
- Implemented data modeling techniques to optimize database structures and performance.
- Maintained data quality standards through regular audits and validation checks.
- Developed ETL processes to extract, transform, and load large datasets efficiently.
- Created ETL scripts to move and transform data from various sources into a centralized repository.
- Azure Deployment Pipeline creation.
- Multi Stage Pipeline validation, approval and monitoring pipeline creation.
- Azure SQL .ispac file is used in Azure pipeline to track the committed changes in Metadata tables changes and deploy through Azure Pipeline.
Data Engineer
PureSoftWare Pvt. Ltd.
10.2023 - 10.2024
- Technology & Language: Azure Data Factory, Azure Datalake Blob, Azure Synaps, Azure Functions, Azure Databricks, ADLSG2, PL/SQL, ETL new design CDC and CDF
- Worked on ELT latest design model Full Load > CDC > CDF with SCD Type - 2 on delta tables within the DataBricks Notebooks.
- Worked on Crypto Encryption for in coming scheduled along with Auto Loader for incremental Data Ingestion from KAFKA and Batch processing as per particular time interval.
- Scheduling the Job Definitions for complex dependent tasks together.
- Insights Policy lead Customer Campaign, Offering the best product as their criteria, lifestyle and Regression in terms of analysis distribution of Policy agents as per the geographical results successful ratio.
- Lapse Customer Analysis and calculating Adjustment amount as per Policy Products and their associate unit rates and units shares invested in market and settle down the claim amount and generate the other leads as well.
- Decommission the SISS packages, TSQL and build the Azure Data Factory pipeline as per the logic of stored procedure and etl tsql queries in dataflow and different activities in pipeline.
- Build the Azure YAML and Azure Pipeline to deploy the IAC for DataBricks Security Governance as per service principal , client id, Azure Vault, Unity Catalog Access and Authority (roles and responsibilities).
- Build Databricks workflow to maintain the execution of approx 45 tables data processing in sequence of Full Load -> CDC Enabling -> CDF for SCD2 Type data migration till Curated Layer.
Data Engineer
Creant Pvt. Ltd.
06.2023 - 10.2023
- Technology & Language: Azure Data Factory, Azure Datalake Blob, Azure Synaps, Azure Functions, Azure Databricks, ADLSG2, COSMOSDB, PL/SQL
Data Engineer
Tredence Pvt. Ltd.
09.2022 - 05.2023
- Technology & Language: Azure Data Factory, Azure Datalake Blob, Azure Synaps, Azure Functions, Azure Databricks, ADLSG2
Data Engineer
Wipro Pvt. Ltd.
03.2021 - 09.2022
- Technology & Languages: PySpark, Parquet, CSV, Azure Data Factory, Azure Datalake Blob, Azure Synaps, Azure Functions, Azure Databricks, ADLSG2
Data Engineer
Birla Soft Technology Pvt. Ltd.
07.2018 - 02.2021
- Project: Manufacturing and Logistic; Technology & Language: PySpark, AWS S3, Parquet, HIVE, SQOOP, CSV, HDFS
- Project: Warehouse Management System
- Project: Abacus and Epsilon Insurance System
DataBase Developer
Data Borrough India Pvt. Ltd.
10.2016 - 07.2018
- Build DataBricks Notebooks for curation transformation by connecting the cosmosdb on premises db and migrate to the Azure delta tables and apply scd type 2 storage mechanism.
- Build the Azure synapse pipeline for analysis purpose on dedicated SQL pool for better scaling analysis application.
- Developed efficient and reliable Azure Data Factory Ingestion Pipelines to facilitate the extraction and processing of large volumes of healthcare data, ensuring accurate and timely data ingestion.
- Utilized Azure Databricks functions to facilitate advanced data analytics processes, providing valuable insights and facilitating proactive decision making.
- Implemented Azure Blob Storage to DBFS (Databricks File System) integration, enabling seamless data transfer and facilitating efficient and accurate data processing.
- Leveraged ADLSG2 (Azure Data Lake Storage Gen2) to store and manage healthcare data, ensuring secure and reliable data storage and access.
- Successfully implemented Azure Synapse Analytics to facilitate efficient and accurate data analysis and reporting, providing valuable insights and facilitating informed decision making in the healthcare sector.
Education
MCA -
Rajiv Gandhi Tech University
01.2013
BCA -
Rani Durgawati Vishwa Vidyalaya
01.2009
Skills
- Microsoft Azure
- Azure Data Lake
- Azure Synapse Analytics
- Azure Databricks
- Azure Data Factory
- Python
- SQL
- Scala
- Core Java
- Linux
- Bash Programming
- Jupyter Notebooks
- Flask
- Azure SQL Database
- Azure Cosmos DB
- SQL Server
- Apache Spark
- Databricks
- SSIS
- Azure Devops Deployment
- Git
- BitBucket
- JIRA
- Co Pilot
- Azure Pipelines creation
- YAML
- Terraform
- Docker
- Kubernetes
- Cloud data architecture
- Problem Solving
- Time Management
- Communication
- Teamwork
- Attention to Detail
- Analytic Skills
- Data pipeline design
- Data modeling
- Problem solving
- ETL processes
- Analytical thinking
- ETL development
- Metadata management
- Data quality assurance
- SQL programming
- Advanced analytics
- Agile methodologies
- Data curating
- API development
Certification
- Microsoft Certified: Azure Data Engineer Associate, I687 9747 (446232126)
- Microsoft Certified: Azure Solution Architect, (443971133), 994757871
<Enter your own>
- Title: SENIOR DATA ENGINEER
- Date of Birth: 1988-06-21
Languages
- English
- Hindi
- Marathi
Timeline
Senior Data Engineer
Systems Plus Pvt. Ltd.
01.2025 - Current
Data Engineer
PureSoftWare Pvt. Ltd.
10.2023 - 10.2024
Data Engineer
Creant Pvt. Ltd.
06.2023 - 10.2023
Data Engineer
Tredence Pvt. Ltd.
09.2022 - 05.2023
Data Engineer
Wipro Pvt. Ltd.
03.2021 - 09.2022
Data Engineer
Birla Soft Technology Pvt. Ltd.
07.2018 - 02.2021
DataBase Developer
Data Borrough India Pvt. Ltd.
10.2016 - 07.2018
MCA -
Rajiv Gandhi Tech University
BCA -
Rani Durgawati Vishwa Vidyalaya
Similar Profiles
Mrutyunjaya MohapatraMrutyunjaya Mohapatra
Security Operation Center Analyst at Systems Plus Pvt. Ltd.Security Operation Center Analyst at Systems Plus Pvt. Ltd.
NABEEL ANWARNABEEL ANWAR
Sales Officer at SABRE TRAVEL NETWORK PAKISTAN (Pvt.) Ltd, Abacus Distribution Systems Pak. (PvtSales Officer at SABRE TRAVEL NETWORK PAKISTAN (Pvt.) Ltd, Abacus Distribution Systems Pak. (Pvt
KARTIK MOHAN PILLAYKARTIK MOHAN PILLAY
Project Manager at Akraya Solutions Pvt Ltd ( Client - Cisco Systems India Pvt Ltd )Project Manager at Akraya Solutions Pvt Ltd ( Client - Cisco Systems India Pvt Ltd )
Soumyadeep GhoshSoumyadeep Ghosh
Graduate Engineer Trainee at Air ProductsGraduate Engineer Trainee at Air Products
Pooja Anil SuryawanshiPooja Anil Suryawanshi
Senior Software Engineer at FIS GlobalSenior Software Engineer at FIS Global