Experienced Data Engineer with 10+ years in consulting, specializing in designing and implementing data-driven solutions to enhance business performance. Proven expertise in building robust data pipelines, optimizing ETL processes, and integrating IT/OT systems across diverse industries. Consistently delivers high-impact projects that improve data accessibility, streamline operations, and support strategic decision-making.
Overview
10
10
years of professional experience
Work History
Big Data Consultant
McKinsey & Company
New Delhi, India
06.2022 - Current
Led the architecture design and implementation of digital, data and tech implementations for multiple clients across different geographies (Asia and Europe)
Developed a central data platform for a bank, significantly reducing dependency on external applications for report generation. This initiative streamlined data access and reporting processes, enhancing operational efficiency and supporting more informed decision-making within the organization
Developed an indication-finding dashboard for a healthcare company, enabling efficient identification and analysis of key clinical indicators. The dashboard streamlined data visualization, improving decision-making processes and supporting the enhancement of patient outcomes
Consulted with a manufacturing client to design and implement integrated IT/OT pipelines aimed at enhancing throughput and yield. The solution involved aligning operational technology (OT) with IT systems, optimizing data flow, and enabling real-time analytics to drive efficiency improvements and increase production output
Optimized the truck utilization index and inventory redeployment between plants and warehouses for multiple supply chain companies in US and South East Asia, improving the utilization by 2% over a period of 6 months
Senior Data Engineer
Sigma Aldrich, Merck Group
Bengaluru, India
07.2021 - 06.2022
Evaluated emerging technologies and tools to identify opportunities for enhancing existing systems or creating new ones
Led the creation of a dashboard on Palantir Foundry, for the commercial sales team to identify the problematic areas in the sale of the company products
Actively worked on the migration of all existing data processing pipelines to Palantir, to make them more efficient, robust and scalable
In addition, optimized the existing data processing pipelines reducing the execution time by 20%
Analyzed complex data and identified anomalies, trends and risks to provide useful insights to improve business statistics
Utilized the Spark/Python expertise to build utilities to parse data and use it for reporting purpose in the downstream projects
Senior Spark Developer
Larsen & Toubro Infotech
Bengaluru, India
04.2021 - 07.2021
Understanding the functionality of the Oracle procedure
Migrating the code to PySpark
Unit/Integration testing
Creating documents for efficient understanding of the Spark code
IT Analyst
Tata Consultancy Services LTD
Bengaluru, India
02.2016 - 04.2021
Worked on proprietary tool/framework for feed on boarding
Implemented framework enhancements/modifications/migration as per the feed on boarding team requirements and to make framework robust, efficient, handling failure restartability and up to date
Resolved malfunctions with systems and programs through troubleshooting.
Education
Master in Computer Applications (MCA) - Computer Science
NIET
Greater Noida
06.2015
Skills
Python
Apache Spark
Cloud services on AWS (primarily Sagemaker, S3, DynamoDB)
SQL
Cloud services on Azure (primarily Databricks, Data factory, Data hub)
Palantir Foundry
Languages
English
Bilingual or Proficient (C2)
Hindi
Bilingual or Proficient (C2)
Quote
The price of anything is the amount of life you exchange for it.
Henry David Thoreau
Timeline
Big Data Consultant
McKinsey & Company
06.2022 - Current
Senior Data Engineer
Sigma Aldrich, Merck Group
07.2021 - 06.2022
Senior Spark Developer
Larsen & Toubro Infotech
04.2021 - 07.2021
IT Analyst
Tata Consultancy Services LTD
02.2016 - 04.2021
Master in Computer Applications (MCA) - Computer Science