Adarsh Jain
Data Engineer
Bengaluru
Summary
Experienced data engineer proficient in building scalable data pipelines and optimizing data infrastructure. Skilled in Scala, Java, Python, SQL, and big data technologies, with a strong focus on delivering efficient solutions to meet business needs.
Overview
2026
2026
years of professional experience
4
4
years of post-secondary education
2
2
Languages
Work History
Senior Data Engineer
Tesco
05.2024 - Current
- Built the FR&I Data Platform as part of the Finance Data Hub to manage financial data in one place.
- Created finance data pipelines using Apache Spark, Databricks, Delta Lake, and Unity Catalog.
- Loaded and processed data from Oracle Fusion, Hyperion Financial Management (HFM), and FDMEE for finance teams and leaders.
- Set up secure access to financial data using Unity Catalog for better control and sharing.
- Worked closely with finance and IT teams to build a strong and reliable data platform.
- Improved performance of ETL workflows by finding slow areas and optimizing the code.
- Ensured high data quality by testing, validating, and monitoring all data, reducing errors and inconsistencies.
Data Engineer
Slice
1 2023 - 05.2024
- Building data processing workflows to clean, transform, and enrich data for analytics and reporting purposes
- Automate Data Pipeline on boarding process to streamline data integration from diverse sources
- Migration of cluster environments from Databricks to EMR clusters
- Build Pyspark data pipelines in both environment Databricks and EMR
- Explore Data governance tools such as Apache-Ranger for implementing the user and group level policies on data lake
- Build Superset dashboards for better tracking of data visibility and S3 API cost changes
- Set up CI/CD pipeline with test-cases in Git Action.
Data Engineer
MakeMyTrip
06.2019 - 01.2023
- Developed various Real-time and Batch Pipelines to capture all click events across all lines of business(i.e
- Flights, Hotels) for both brands (MMT and GI) using spark, scala, kafka, delta-table
- Explore different types of AWS instance groups for cost & job run-time optimization
- Build various Dashboards to track the data quality of the pipeline using Athena & Redash
- Build streaming platform for processing various type of sources and sinks(i.e
- Kafka, Parquet, JSON, Delta & Avro) through configurations
- Developed ClickStream Meta Store, that captures all lines of business data and converts them into unified schema
- Built various dashboards to track the Quality of Clickstream Datasets using Glue and AWS Athena
- Created Airflow Dags to launch EMR clusters and schedule Spark ETL jobs on the basis of user-provided configurations.
Software Engineer
OpenText
04.2018 - 06.2019
- Involved as a developer (Software Engineer- Product Development) to the team
- Responsible for writing Power shell scripts for window installers
- Designed Window installer User interface
- Integrated Apache Kafka for data ingestion with Apache-Spark streaming for real time data analysis
- Responsible for understanding the new requirements and enhancing the code and implementing logic for the same
- Execute coding, testing, documentation according to plan and time schedule.
Software Engineer
Wipro Technology (India) Pvt. Ltd
Bangalore
09.2015 - 02.2018
- Involved as a developer (Software Engineer- Product Development) to the team
- Integrated Apache Kafka for data ingestion with Apache-Spark streaming for real time data analysis
- Analysis data using Apache-Spark APIs
- Responsible for understanding the new requirements and enhancing the code and implementing logic for the same.
Education
Bachelor of Engineering - Information Technology
Institute of Engineering & Technology, DAVV
Indore 08.2011 - 06.2015
Skills
Spark
Pyspark
Cassandra
MongoDB
Postgres
Delta Lake
Python
Scala
Java
Timeline
Senior Data Engineer
Tesco
05.2024 - Current
Data Engineer
MakeMyTrip
06.2019 - 01.2023
Software Engineer
OpenText
04.2018 - 06.2019
Software Engineer
Wipro Technology (India) Pvt. Ltd
09.2015 - 02.2018
Bachelor of Engineering - Information Technology
Institute of Engineering & Technology, DAVV
08.2011 - 06.2015
Data Engineer
Slice
1 2023 - 05.2024