Experienced Data Engineer with 3+ years of hands-on experience in designing, implementing, and managing complex data pipelines and systems. Proven ability to collaborate with cross-functional teams and deliver impactful data solutions.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Associate Data Engineer
Teradata
Pune
09.2022 - Current
Completed modernization of American Airlines B2B Sales 200+ Legacy DataStage jobs and 20+ tables to Azure Cloud.
Worked to set up Azure Data Factory Dependencies which will no longer require Legacy Scheduler Tool for scheduling and uses Azure Event Hub capabilities. Collaborated with different teams within American Airlines to understand Jobs Dependencies and to set Event Grid Topics.
Redesigned Azure Data Factory Pipelines for Modernized applications to follow one central Master Notebook Approach which drives the concurrent Azure Databricks operations which in turn reduced Azure Costs by 70% in 2024 Q2 in comparison with Q1.
Implemented Retry Logic to reduce frequent Workflow failures due to deadlock and cluster failures which has reduced Production Support Incidents by 80%.
Worked on American Airlines Sales Overhaul Program to modify and develop 80 Notebooks, 34 Views and 18 control tables to provide the Business with the flexibility and data required to customise Sales Agency Contracts.