

Experienced Data Engineer with 3+ years, adept in optimizing data processes and quality using SQL, BigQuery, and collaborative problem-solving. Successfully led the migration of Kohl's EDW to BDA, enhancing business performance. Skilled in automation, advanced data modeling, and Agile methodologies. Proficient in building and automating data pipelines, with a strong focus on data quality and accessibility.
Project Name: Beam Suntory (CPG) (May 2023 - Present)
Job Responsibilities:
- Collecting data from multiple sources and cleaning the data using unification for identifying users across the sources and helped the PowerBI team to build a dashboard on the same.
- Transporting data from Presto db to GCP
- Worked closely with multiple business users to implement requested features and changes in data as well suggesting the changes.
- Managed and developed dynamic pipelines to comply with GDPR rules and regulation for PII data. Tracked down major bugs in data pipelines.
Project Name: YBL Olympiad (Banking) (Sept 2022 - April 2023)
Job Responsibilities:
- Conducted data analysis and debugging.
- Collaborated with the team to design and implement a comprehensive smoke testing script for table validation.
- Managed project tasks and deliverables.
- Executed Azkaban jobs and handled debugging when necessary, also conducted table testing. - Proficient in Big Data querying tools such as Hive, Sqoop, and Hadoop.
Project Name: Kohl's EDW to BDA (Teradata to BigQuery) (Retail Store) (Feb 2021 - August 2022)Project involved migrating Kohl's data from EDW (Enterprise Data Warehouse) to BDA (Big Data Analytics). Job Responsibilities:
- Optimization of older processes and scripts for better functionality.
- Experience in handling huge data between GCP and on-prem clusters.
- Analyzed the existing logic in Kohl's EDW environment and replicated it in BigQuery.
- Conducted Teradata to BigQuery migration. - Improved business performance as per SCD 1/2/3 requirements.
- Had experience in all stages of development, from initial analysis to deployment in a production environment. Familiar with GCP services like BigQuery and Cloud Storage.
● Programming: SQL, Basic Python, Basic JAVA, Shell Script, Pyspark
● Database: Bigquery, Hive, Oracle, Teradata,Presto SQL
● Orchestration: Airflow, Azkaban, Composer
● CICD and Version Control: GitHub, Jenkins, Git Actions