SAURABH KHAIRNAR
Lead Data Engineer
Pune
Summary
Lead Data Engineer with 11.2 Years of experience in GCP , CI-CD/DevOps , Cloud , Big data analytics , On Premise to Cloud Migration and ETL technologies with a proven record of delivering and solving complex problems that meets tight deadlines with superior performance. 3 Years of experience in leading onshore team in London, UK for major telecom client. Skilled in delivering end to end large scale enterprise data lake , data warehouse and cloud applications with hands on experience on major Cloud technologies as GCP , BigQuery , Dataflow , DataProc , Airflow , Spark/Hive , Teradata , Scala/Java , GitHub/GitLab, Jenkins/Spinnaker CI-CD Pipeline , Tivoli Scheduler. Built and fostered a high-performing team. Mentored subordinate team members, improving their overall skills.
Overview
12
12
years of professional experience
4
4
years of post-secondary education
2
2
Certifications
Work History
Lead Data Engineer
Wipro
02.2025 - 08.2025
- Day-to-day client and stakeholder engagement. Requirement gathering and conversion into an assessment report.
- Implementation of Dataflow/Dataproc DAGs to bring the data from the Teradata on-premise system to GCP BigQuery Cloud, and fine-tuning the queries and data.
- Collaborated with cross-functional teams to implement on-premise Teradata to GCP (Google Cloud Storage) data migration.
- Conversion of Teradata SQL (BTEQ) scripts to Google SQL using BigQuery SQL Translator and optimizing them.
- Implementation of audit reconciliation for capturing BigQuery Core and Stage table counts, as compared to the source.
- Migrate Teradata DM Express and Zeke scheduler jobs into Cloud Composer: Airflow DAGs.
- Leading the team for successful delivery and meeting tight project deadlines with superior performance.
Offshore Senior Data Engineer/Lead
Accenture
01.2018 - 01.2025
- Lead and developed CI/CD pipelines using GCP Storage, Kubernetes, Spark/Scala, GitHub, Jenkins, Spinnaker, BigQuery (BQ), DataProc, and Hive, following an agile mode of delivery.
- Written framework to load the data from Hive to BigQuery for further analytics.
- Implementation of Airflow DAGs to streamline the pipeline and DAG deployment using Cloud Composer and Dataproc.
- Implementation of the reconciliation and validation script in Shell and Scala Spark to ensure minimum or zero defects in migration and achieve optimum data quality.
- Identified as the go-to person for Big Data, GCP, and DevOps across teams.
- Continuous client interaction and active work in a production environment, ensuring timely delivery and minimal incidents.
- Lead and delivered successful production deployments and go-live.
Onshore Senior Data Engineer/Lead
Accenture
01.2021 - 01.2023
- Worked as an onshore technical lead at the client location in the UK, demonstrating broad solutions technical leadership, day-to-day interaction with the client, business stakeholders, and cross-functional teams to translate business requirements into technical.
- Designed and implemented an end-to-end data lake using Hadoop, Hive, Qlik (Attunity), Ab Initio, NiFi, Kafka, and Oracle.
- Maintaining history by implementing SCD2 logic.
- Perform data validation and verification during the testing phase, assuring data integrity.
- Designed, implemented, and effectively migrated on-premise Hadoop data to native GCP for faster retrieval and timely delivery.
Senior Analyst
KPIT Technologies
01.2014 - 01.2018
- Responsible for the development of Spark Streaming code and analytics in Java/Scala to stream real-time client data.
- Sentiment analysis and language translation using NLP.
- Applied Spark SQL and transformations to rectify and create analytics-ready data, and populate it on the Tableau visualization tool.
- Creation of Hive external tables, scripts, and exposing them to the data visualization layer through Tableau.
Education
Bachelors Of Engineering - Information Technology
University Of Pune
01.2009 - 01.2013
Skills
- Google Cloud Platform(GCP)
- Big Query
- Dataflow and Dataproc
- Apache Airflow - Cloud Composer
- Hadoop , Hive , Spark
- On Premise (Hadoop , Teredata etc) to GCP Cloud Migration
- Teradata
- GitHub , GitLab , GitHub Actions
- Jenkins/Spinnaker , CI-CD Pipeline
- Kafka Java , Py and Scala
- Oracle , MySQL, Cassandra NoSQL
- Qlik(Attunity) Replicate and Compose ETL
- Onshore client interaction and stakeholder's engagement
- Technical Architecture Design
- Business Documentation
- Cloudera Data Platform
- Production incident reporting and management
- Shell Scripting
- Jira/Confluence
- Tableau
Certification
Google Cloud Certification - Professional Data Engineer
Timeline
Lead Data Engineer
Wipro
02.2025 - 08.2025
Onshore Senior Data Engineer/Lead
Accenture
01.2021 - 01.2023
Offshore Senior Data Engineer/Lead
Accenture
01.2018 - 01.2025
Senior Analyst
KPIT Technologies
01.2014 - 01.2018
Bachelors Of Engineering - Information Technology
University Of Pune
01.2009 - 01.2013
Similar Profiles
Ankan BeraAnkan Bera
Application Architect at WiproApplication Architect at Wipro
Dhanasekaran GDhanasekaran G
Solution Architect in AI & Data Analytics / M365 / Power Platforms/ Azure at WiproSolution Architect in AI & Data Analytics / M365 / Power Platforms/ Azure at Wipro
Jenna LegerJenna Leger
Medical Services Coordinator at WiproMedical Services Coordinator at Wipro
Yogesh YadavYogesh Yadav
Senior Analyst at WiproSenior Analyst at Wipro
Niraj DigheNiraj Dighe
Lead Software Engineer at Cloud Software GroupLead Software Engineer at Cloud Software Group