Shivangi Sharma
Gurugram
Summary
A dedicated Data Engineer with 6+ years of experience in the Big Data domain, I have contributed to various projects across Healthcare, Telecom, Travel & Media industries. My expertise lies in designing and executing complex ETL/ELT/Big Data pipelines, utilizing a range of advanced technologies.
Overview
7
7
years of professional experience
2
2
Languages
Work History
Data Engineer III
Nielsen Media
Gurgaon
09.2024 - Current
- Worked on building a data product for cross-media audience measurement of advertising campaigns across four screens: Computer, Mobile, CTV, and Linear TV
- Worked on building end to end data pipeline for India TV audience measurement involving active collaborations with leadership and product teams
Data Engineer II
Expedia Group
Gurgaon
01.2022 - 09.2024
- Created a data monitoring product which takes care of data availability, data profiling, alerting
- Created cohort retention analysis tool which tracks like customer retention, sales retention etc
- Design and development of Data/ETL pipelines and workflows for various metrics for BI & Product Analytics stakeholders
Sr. Data Engineer
Airtel Africa Digital Labs
01.2021 - 01.2022
- Building generic framework to ingest data into the data warehouse from raw zone to data lake using spark etl jobs and scheduling using airflow
- Creating end to end data pipelines - from fetching raw data from various sources (nifi, kafka) to doing complete transformations and making data dashboard ready.
- Created a test environment for pre production deployment using Cloudera
- Complete POC & implementation on optimizing the reading/writing process from spark tables and shifting from parquet format to HUDI
- Leading the team and supporting them in development
Business Technology Analyst
ZS Associates
01.2019 - 01.2021
- Played a key role in designing the data warehouse and implementing it on AWS cloud using various services like EMR, S3, Lambda, Redshift.
- Developed complex tableau dashboards that takes advantages of all Tableau functions, including data blending, actions, parameters, context filters handling huge volume of data.
- Single handedly managed all phases of Software Development Life Cycle (Requirement Gathering, Design, Coding, Testing and Deployment).
- Interfaced with clients and onshore leads to identify business problems, gather and understand their business needs and requirements.
Education
Bachelor Of Engineering -
Army Institute of Technology, SPPU
Pune01-2019
Skills
Accomplishments
- Awarded PM scholarship,ZS Associates scholarship,LPF scholarship
- National rank holder in TSI Math Olympiad
- Selected for UDAAN scheme by M.H.R.D
- Got ZS Top Performer Reward - Q3 2020
- Received several shout-outs on Expedia, including recognition as a Team Player and Heroic Helper, and was nominated for the My Hero Award.
Timeline
Data Engineer III
Nielsen Media
09.2024 - Current
Data Engineer II
Expedia Group
01.2022 - 09.2024
Sr. Data Engineer
Airtel Africa Digital Labs
01.2021 - 01.2022
Business Technology Analyst
ZS Associates
01.2019 - 01.2021
Bachelor Of Engineering -
Army Institute of Technology, SPPU