Data Engineer with 2+ years of expertise in designing and optimizing data pipelines using Azure, ADF, PySpark, and SQL. Strong foundation in ETL workflows, cloud data migration, and data modeling. Adept at ensuring data integrity, improving system reliability, and enabling advanced analytics across Azure and on-premises platforms.
Azure Data Lakehouse, Designed ETL pipelines using ADF and PySpark to support real-time analytics, reducing processing time by 35%.
Automated Data Quality Framework, built a Python-based validation system integrated with Azure Monitor to maintain data accuracy.
Customer 360 ETL, Developed metadata-driven ETL pipelines in Azure Synapse for unified customer data analytics.