PROGRAMMER ANALYST | CLOUD DATA ENGINEER
Cognizant Technology Solutions
Pune
03.2023 - Current
- Spearheaded data migration initiatives from Teradata to Azure Synapse, collaborating with cross-functional teams to ensure alignment with data governance standards and business goals
- Designed and deployed scalable ETL pipelines in Azure Data Factory (ADF), utilizing Data Flow and Databricks for complex transformations, schema mapping, and data type conversions to maintain data integrity
- Implemented Medallion Architecture for data lakes, improving data quality and enabling advanced analytics across multiple projects
- Optimized large-scale data migration with incremental loading strategies, minimizing downtime and enhancing overall performance
- Developed and maintained Databricks notebooks for data processing and analysis, leveraging PySpark for efficient data cleaning, transformation, and distributed processing
- Established robust error-handling mechanisms and automated monitoring, improving pipeline reliability and reducing operational downtime
- Documented data migration best practices and led knowledge-sharing sessions to enhance team collaboration and skill development
- Technologies Used: Azure Data Factory (ADF), Databricks, Python, PySpark, SSMS, Azure Storage Explorer, WinSCP, PuTTY.
