Mayur Sonawane
Data Engineer
Chh. Sambhaji Nagar
Summary
Results-oriented Data Engineer with over three years of specialized experience in architecting and enhancing data pipelines utilizing AWS Cloud, Databricks, DBT, and Snowflake. Proficient in designing and executing robust medallion architectures and ETL workflows that convert complex, raw data into actionable business insights. Skilled in data integration, warehouse management, and pipeline automation, emphasizing performance optimization and data quality assurance.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Software Development Engineer
Bridgenext India Private Limited
Pune
10.2023 - Current
- Architected and maintained cloud-based data pipelines using AWS, Databricks, DBT, and Snowflake, increasing data processing efficiency by 30%.
- Designed and implemented Delta Lake workflows using a medallion architecture (bronze, silver, and gold layers), ensuring data quality and accessibility for business users.
- Developed optimized Databricks notebooks to execute complex transformations on raw data, reducing processing time by 25%.
- Engineered automated data workflows between Databricks and Snowflake, decreasing manual intervention by 40%, and ensuring timely data delivery.
- Implemented continuous monitoring solutions for pipeline performance, maintaining 99.8% uptime while handling 8 or more different primary data sources.
Associate Data Engineer
Triboclad Tech Pvt Ltd
Bangalore
02.2022 - 10.2023
- Executed seamless data migration from Oracle databases to AWS cloud infrastructure using AWS DMS, maintaining 99.9% data integrity.
- Designed and implemented ETL workflows using AWS Glue and Lambda for data transformation and analysis, processing insurance data.
- Built a scalable data warehouse using Amazon Redshift that improved query performance by 40% and supported complex analytics for business intelligence.
Education
BBA -
Vivekanand Arts, Sardar Dalip Singh Commerce & Sci
Chh. Sambhaji Nagar07-2019
Skills
- Cloud technology
- Data pipeline architecture
- ETL development
- Version control and CI/CD: GitLab, Git, AWS CodePipeline
- Big Data technologies: Hadoop, Hive, HDFS, PySpark (Core and SQL), Delta Lake
- Programming and database: Python, SQL, MySQL, Oracle, PostgreSQL
- Data warehousing
- Data modeling
- Data analysis
- Cloud platforms: AWS (DMS, RDS, EC2, S3, Redshift, EMR, Glue, Athena), Databricks, Snowflake
- Development environments: PyCharm, Visual Studio, Jupyter Notebook
Certification
- AWS Certified Solutions Architect - Associate
- Databricks Lakehouse Fundamentals
- HackerRank SQL certifications (basic, intermediate, advanced)
- HackerRank Python (basic) certificate
- HackerRank problem-solving certificates (basic, intermediate)
Accomplishments
- Bridgenext Excellence Award
Timeline
Software Development Engineer
Bridgenext India Private Limited
10.2023 - Current
Associate Data Engineer
Triboclad Tech Pvt Ltd
02.2022 - 10.2023
BBA -
Vivekanand Arts, Sardar Dalip Singh Commerce & Sci
Similar Profiles
SHIVAPRASAD K PSHIVAPRASAD K P
Finance Executive at AIX Connect India Private Limited (Formerly Known as Airasia India Private Limited)Finance Executive at AIX Connect India Private Limited (Formerly Known as Airasia India Private Limited)
Sanjeet SinghSanjeet Singh
Associate instrument at Roqqette India private limited under ms Randstad India private limitedAssociate instrument at Roqqette India private limited under ms Randstad India private limited
Vasuda KrishnamurthyVasuda Krishnamurthy
Financial Analyst at EMC SOFTWARE AND SERVICES INDIA PRIVATE LIMITED/Dell, Technologies India Private LimitedFinancial Analyst at EMC SOFTWARE AND SERVICES INDIA PRIVATE LIMITED/Dell, Technologies India Private Limited
Mahesh Vitthalrao DhageMahesh Vitthalrao Dhage
Line Engineer at Bajaj Auto Pvt .Ltd.Line Engineer at Bajaj Auto Pvt .Ltd.
Mrunal MuleMrunal Mule
Assistant Professor at MITAssistant Professor at MIT