Lead Data Engineer experienced in building scalable data infrastructures and optimizing data architectures. Developed advanced data pipelines that supported business intelligence and analytics through effective team collaboration and technical expertise. Focused on driving data-driven decision-making and leading data engineering initiatives.
Overview
3
3
Languages
7
7
years of professional experience
Work History
Lead Data Engineer
Infosys Limited Pune
Pune, India
11.2025 - Current
Led ETL pipeline development using PySpark, Spark SQL, and Databricks for scalable data processing.
Designed data models and curated warehouse layers to support analytics and reporting needs.
Optimized SQL queries and transformation logic to improve data quality and processing efficiency.
Orchestrated batch workflows with Airflow and monitored job dependencies for reliable execution.
Followed Mendelian architecture and used AI for the record-time delivery in production.
Mentored junior engineers on coding standards, debugging practices, and production support routines.
Collaborated with stakeholders to translate business requirements into technical data solutions.
Multiple ERPs from multiple countries had a common data model problem and solved it by creating a global data model with automated updates.
Handled raw, bronze, silver, and gold layers of data, and developed, productionized, and supported in Hypercare and AMS.
Collaborated with cross-functional teams to gather requirements, ensuring seamless integration of data engineering solutions into existing systems.
Implemented monitoring systems to proactively identify potential bottlenecks in the data pipeline, ensuring optimal performance at all times.
Increased efficiency of ETL processes by automating manual tasks, reducing processing time and resource consumption.
Data Integration Engineer
Infosys Limited Pune
Pune, India
03.2023 - 11.2024
Developed API and middleware integrations using REST,APIM and message-driven architectures.
Troubleshot interface failures, identified root causes, and restored data flow across connected applications.
Collaborated with developers, testers, and support teams to resolve integration defects and deployment issues.
Configured message mappings, transformation rules, and routing logic for reliable system communication.
Developed API and middleware integrations using REST and message-driven architectures.
Troubleshot production interface failures, resolving mapping, connectivity, and transformation issues.
Automated deployment and validation steps through CI/CD pipelines and script-based checks.
Senior Project Engineer
Wipro Limited
ELECTRONIC CITY, KARNATAKA
02.2021 - 02.2023
Project Description
Contributed to Project Quantum, Wipro's largest digital transformation initiative, migrating legacy systems including Oracle, MSSQL, and SAP to Microsoft Azure cloud solutions.In the project I was mainly handling CRM and sap data which the data was first ingested in Azure data lake in parquet format with snappy compression technique and then it was cleaned using Azure Dataflows in Azure data factory. Conducted data validation and applied transformations based on business requirements after data cleaning. Finally the data is loaded to azure SQL pool which was our data Warehouse and we implemented the fact and dimensions table logics there and we implemented SCD on some tables as per the requirement
Led cross-functional project execution, aligning scope, timelines, and technical deliverables with stakeholder expectations.
Coordinated engineering teams to resolve design issues, remove blockers, and maintain project continuity.
Azure Data engineer L3
Wipro limited
Karnataka
08.2019 - 02.2021
Tasks and Experience
Designing complex data flows
Orchestrated data pipelines to ensure seamless data flow and integration across systems.
Advanced SQL query
Managed CI/CD pipelines with DevOps practices to streamline deployment processes and improve code reliability.
Big data cleaning and analysis
Executed data transformations to enhance data quality and accessibility for analysis.
Data warehousing and SCD implementation
Data Integration
Database Security implementation using key vault
Led Azure Data Factory pipeline development for scalable ETL workflows.
Designed Synapse-based data models supporting analytics and reporting needs.