Results-driven Data Engineer with expertise in optimizing SQL queries and automating workflows using Airflow. Proven problem-solving skills enhance data accuracy and reporting processes. Proficient in Python and AWS, with a strong ability to communicate effectively. Leverage cutting-edge technologies to drive data-driven strategies, and deliver actionable insights.
Overview
4
4
years of professional experience
Work History
Associate Data Engineer
Cognizant Technology Solutions (Client: Chewy)
Noida
10.2024 - Current
Led data validation efforts, identifying discrepancies between source and target systems.
Optimized complex SQL queries to detect and retrieve missing data, enhancing report accuracy.
Designed and implemented an Airflow DAG to automate data validation, categorizing results as 'Pass' or 'Fail.'
Developed a Python utility to validate and output data to CSV, uploading results to AWS S3.
Integrated SQL query execution into the DAG for data integrity checks.
Configured email notifications for validation failures, ensuring timely data quality management.
Improved data accuracy and reporting processes through end-to-end workflow orchestration with Airflow.
Associate Data Engineer
Cognizant Technology Solutions (Client: Nike)
09.2023 - 10.2024
Developed and maintained data pipelines at Nike using Apache Airflow, managing multiple Directed Acyclic Graphs (DAGs), scheduled for timely execution.
Conducted thorough data analysis using SQL and Power BI, deriving actionable insights to inform strategic decisions.
Leveraged SQL for efficient data querying and manipulation, enabling comprehensive analysis and visualization of key metrics.
Created dynamic Power BI dashboards, providing stakeholders with intuitive visualizations for informed decision-making, and performance tracking.
Contributed to Nike's data-driven strategy by utilizing cutting-edge tools and technologies for data analysis and research.
Programmer Analyst/ Data Engineer
Cognizant Technology Solutions (Client: BHP)
07.2021 - 08.2023
Migrated multiple jobs from ODR to Snowflake using DBT Cloud, demonstrating expertise in GitLab, BODS Designer, Snowflake, and Oracle.
Focused on Data Warehouse ETL testing, promptly identifying and resolving issues to ensure smooth data flows.
Optimized SAP jobs to build efficient data pipelines, enhancing data processing capabilities.
Developed and implemented data pipelines from Oracle to Snowflake, adhering to BODS logic and client requirements.
Proficient in DBT Cloud for data pipeline development, with hands-on experience in various DBT functions.
Conducted unit testing, deployment, and documentation of pipelines to ensure reliability and scalability.
Skilled in root cause analysis and scenario planning, enabling proactive problem-solving and strategic decision-making.
Senior Front End Developer at Cognizant Technology Solutions - Client: VerizonSenior Front End Developer at Cognizant Technology Solutions - Client: Verizon