Sohan Sinha

Capgemini Technologies

Mumbai, MH

09.2022 - Current

Developed scalable ETL pipelines using Azure Data Factory capable of processing high volumes of production data.
Implemented optimization techniques that improved business efficiency by 30%.
Established data governance and management techniques, enhancing data quality and compliance.
Developed parameterized and dynamic pipelines to handle various ingestion formats (CSV, JSON, and Parquet).
Implemented robust logging, error handling, and alerting mechanisms.
Integrated ADF with cloud storage and on-premises storage.
Collaborated with cross-functional teams to design data ingestion strategies from various on-premises and cloud-based systems.
Ensured timely deployment aligned with project milestones and business goals.
Monitored and debugged workflow failures, improving data pipeline reliability.
Achieved 99.8% SLA compliance across all production data pipelines by implementing proactive monitoring and error handling.
Designed and orchestrated Mapping Data Flows with activities.
Automated incremental data loads by scheduling Azure Data Factory pipelines for daily and monthly processing reducing manual effort by 90%.
Developed Azure Data Lake Storage (ADLS) solutions, ensuring secure and scalable data storage.
Applied the medallion architecture to optimize data organization and processing.
Scheduled Databricks notebooks with ADF activities.
Adept in leveraging CI/CD practices and Azure DevOps to ensure robust and repeatable data deployment processes.

Similar Profiles