Neeraj Mehta
Mumbai
Summary
Dynamic Senior Data Engineer with a proven track record at Procter & Gamble, excelling in data pipeline design and ETL optimization. Skilled in Python and Azure, I enhance data accuracy and efficiency while fostering collaboration across teams. Passionate about leveraging cloud technologies to drive impactful data solutions and streamline processes.
Overview
7
7
years of professional experience
Work History
Senior Data Engineer
Procter & Gamble
Mumbai
02.2024 - Current
- Project Leadership: Led the engineering development of the NEXA Data platform, facilitating a transition from the existing AMA DataHub and enabling a composite solution across 13 Market Operations (MOs) and 9 Customer Business Units (CBUs).
- Data Management: Managed and streamlined the handling of over 20TB of data, ensuring high availability and data accuracy through a left-shift approach utilizing industry-standard medallion architecture.
- Stakeholder Coordination: Successfully navigated the complexities of managing 75+ stakeholders, driving collaboration and alignment across diverse teams.
- Cost Savings: Achieved an annual operational cost reduction of $1MM through strategic simplification, consolidating over 300 reports and reducing 200+ data signals.
- Efficiency Improvements: Enhanced operational efficiency by reducing cloud costs and critical job execution time by 50%; implemented best practices and optimizing data workflows.
- Operational Advancements: Integrated advanced tools and methodology such as Flexshare, Spyglass, and Workspace insights to drive operational improvement and data governance.
- AI Transformation: Positioned the NEXA data platform as a foundational element of AI/ML transformation towards becoming an AI-first business amidst a complex external business landscape.
Senior Data Engineer
Jet2 Travel Technologies
Pune
11.2023 - 02.2024
- Analyzed existing pipeline and developed comprehensive documentation to streamline onboarding of new hires.
- Gained hands-on experience with end-to-end data workflows on the Google Cloud Platform, including storage, transformation, orchestration, and analysis.
- Collaborated with analytics and data engineering teams to refactor legacy DBT models, improving performance and maintainability.
Senior Software Engineer
Tietoevry
Pune
09.2021 - 11.2023
- Designed, developed, and maintained data pipelines for data ingestion from various sources, ensuring data quality and accuracy.
- Integrated data from diverse sources, both on-premises and in cloud, to achieve data consistency and reliability.
- Implemented data transformation processes using Azure services like Azure Databricks, Azure Data Factory - Dataflow.
- Developed and optimized data models and schemas for efficient data storage and retrieval using Azure SQL Database.
- Implemented data security measures, including encryption and access controls, to protect sensitive information and ensure compliance with regulations.
- Monitored and troubleshooted data pipelines and databases, identifying and resolving issues to maintain system performance and reliability.
- Collaborated with cross-functional teams, including data scientists and business users, to understand data requirements and deliver appropriate datasets.
- Documented data engineering processes, data flows, and data lineage to facilitate knowledge sharing and maintainability.
System Engineer
TATA Consultancy Services Ltd
Noida
08.2018 - 09.2021
- Designed, developed, and maintained end-to-end data solutions, including data ingestion, transformation, modeling, and visualization using Azure services.
- Created visually compelling and interactive reports and dashboards on Power BI or Spotfire, incorporating data from various sources for data-driven decision-making.
- Developed ETL processes using Azure Data Factory to extract, transform, and load data from diverse sources into Azure data storage solutions.
- Implemented data transformation and processing using Azure Databricks, Azure Data Lake Analytics, or other relevant tools to ensure data quality and reliability.
- Utilized SQL, Python, or other programming languages to perform complex data manipulations, calculations, and aggregations.
- Provided support and guidance to juniors, sharing knowledge and best practices to enhance team's capabilities.
- Collaborated with cross-functional teams, including data analysts and business users, to understand reporting requirements and deliver insightful visualizations.
Education
B. Tech - Computer Engineering
College of Technology
Pantnagar, Uttrakhand05.2018
Skills
- Hive
- Spark
- Python and SQL
- Cloud platforms: Azure, AWS, GCP
- Databricks
- Data Factory, Glue
- Athena
- Snowflake, Redshift, BigQuery
- Data lake, S3
- Event Hub
- Git
- Power BI
- CI-CD Azure DevOps
- Airflow
Languages
Hindi
First Language
English
Proficient (C2)
C2
Accomplishments
- Got an annual IT award - IT Build & Create, Recognized for leading the NEXA Data Platform, delivering $1MM+ annual cost savings, streamlining 20 TB+ data, and positioning it as a core enabler of AI/ML transformation.
Timeline
Senior Data Engineer
Procter & Gamble
02.2024 - Current
Senior Data Engineer
Jet2 Travel Technologies
11.2023 - 02.2024
Senior Software Engineer
Tietoevry
09.2021 - 11.2023
System Engineer
TATA Consultancy Services Ltd
08.2018 - 09.2021
B. Tech - Computer Engineering
College of Technology