Adarsh Jain
Data Engineer
Bengaluru
Summary
Experienced data engineer proficient in building scalable data pipelines and optimizing data infrastructure. Skilled in Scala, Java, Python, SQL, and big data technologies, with a strong focus on delivering efficient solutions to meet business needs.
Overview
2026
2026
years of professional experience
4
4
years of post-secondary education
2
2
Languages
Work History
Senior Data Engineer
Tesco
05.2024 - Current
- Built the FR&I Data Platform as part of the Finance Data Hub to manage financial data in one place.
- Created finance data pipelines using Apache Spark, Databricks, Delta Lake, and Unity Catalog.
- Loaded and processed data from Oracle Fusion, Hyperion Financial Management (HFM), and FDMEE for finance teams and leaders.
- Set up secure access to financial data using Unity Catalog for better control and sharing.
- Worked closely with finance and IT teams to build a strong and reliable data platform.
- Improved performance of ETL workflows by finding slow areas and optimizing the code.
- Ensured high data quality by testing, validating, and monitoring all data, reducing errors and inconsistencies.
Data Engineer
Slice
1 2023 - 05.2024
- Building data processing workflows to clean, transform, and enrich data for analytics and reporting purposes
- Automate Data Pipeline on boarding process to streamline data integration from diverse sources
- Migration of cluster environments from Databricks to EMR clusters
- Build Pyspark data pipelines in both environment Databricks and EMR
- Explore Data governance tools such as Apache-Ranger for implementing the user and group level policies on data lake
- Build Superset dashboards for better tracking of data visibility and S3 API cost changes
- Set up CI/CD pipeline with test-cases in Git Action.
Data Engineer
MakeMyTrip
06.2019 - 01.2023
- Developed various Real-time and Batch Pipelines to capture all click events across all lines of business(i.e
- Flights, Hotels) for both brands (MMT and GI) using spark, scala, kafka, delta-table
- Explore different types of AWS instance groups for cost & job run-time optimization
- Build various Dashboards to track the data quality of the pipeline using Athena & Redash
- Build streaming platform for processing various type of sources and sinks(i.e
- Kafka, Parquet, JSON, Delta & Avro) through configurations
- Developed ClickStream Meta Store, that captures all lines of business data and converts them into unified schema
- Built various dashboards to track the Quality of Clickstream Datasets using Glue and AWS Athena
- Created Airflow Dags to launch EMR clusters and schedule Spark ETL jobs on the basis of user-provided configurations.
Software Engineer
OpenText
04.2018 - 06.2019
- Involved as a developer (Software Engineer- Product Development) to the team
- Responsible for writing Power shell scripts for window installers
- Designed Window installer User interface
- Integrated Apache Kafka for data ingestion with Apache-Spark streaming for real time data analysis
- Responsible for understanding the new requirements and enhancing the code and implementing logic for the same
- Execute coding, testing, documentation according to plan and time schedule.
Software Engineer
Wipro Technology (India) Pvt. Ltd
Bangalore
09.2015 - 02.2018
- Involved as a developer (Software Engineer- Product Development) to the team
- Integrated Apache Kafka for data ingestion with Apache-Spark streaming for real time data analysis
- Analysis data using Apache-Spark APIs
- Responsible for understanding the new requirements and enhancing the code and implementing logic for the same.
Education
Bachelor of Engineering - Information Technology
Institute of Engineering & Technology, DAVV
Indore 08.2011 - 06.2015
Skills
Spark
Timeline
Senior Data Engineer
Tesco
05.2024 - Current
Data Engineer
MakeMyTrip
06.2019 - 01.2023
Software Engineer
OpenText
04.2018 - 06.2019
Software Engineer
Wipro Technology (India) Pvt. Ltd
09.2015 - 02.2018
Bachelor of Engineering - Information Technology
Institute of Engineering & Technology, DAVV
08.2011 - 06.2015
Data Engineer
Slice
1 2023 - 05.2024
Similar Profiles
Meena Reid D.o.B: 22-07-1977Meena Reid D.o.B: 22-07-1977
Fulfillment Shift Leader at TescoFulfillment Shift Leader at Tesco
Declan McAllisterDeclan McAllister
Customer assistant at TescoCustomer assistant at Tesco
Aled RichardsAled Richards
Admin Team Manager at TescoAdmin Team Manager at Tesco
AZMAIN ADIL RIFATAZMAIN ADIL RIFAT
Retail Assistant at TESCORetail Assistant at TESCO
PARTHIV RAJAGOPALPARTHIV RAJAGOPAL
Associate System Engineer at THOMSON REUTERSAssociate System Engineer at THOMSON REUTERS