Abhishek Chougule

Client: National Netherlands (Health & Insurance Domain)
Project: NN Migration – Moving Data Workflows to a Modern System (January 2024 - Present).

• Designed and built complete data pipelines using Azure Data Factory, which made data processing 20% faster.
• Set up Azure Logic Apps to send data to Event Hub, helping the system handle real-time data smoothly.
• Built Power BI dashboards that show real-time updates from different data sources, helping the business make quick decisions, and saving 30% of the time spent on manual reports.
• Improved Azure SQL Database queries to make data load faster, reducing wait time by 40%.
• Managed deployment using Azure DevOps and CI/CD pipelines, including moving code and updates from development to production.
• Monitored and troubleshooted workflow using Azure Monitor, Log Analytics and Application Insights to proactively identify system issues.

Client: Parexel International (Healthcare Domain)

Project: Data Migration and Reporting Enhancement (May 2022 - January 2024).

• Designed and implemented a Medallion Architecture (bronze, silver, gold layers) to optimize clinical and financial data workflows, enabling efficient storage, organization, and access.
• Led the migration of ETL processes from Informatica to Databricks, utilizing PySpark for complex transformations and Databricks notebooks for seamless orchestration, ensuring a smooth transition with improved performance and maintained data integrity.
• Implemented Slowly Changing Dimensions (SCD) logic using PySpark to accurately track historical data changes, enhancing consistency and timeliness of reporting in Power BI.
• Leveraged Azure Data Factory to design and orchestrate real-time data pipelines across multiple environments, integrating PySpark-based transformations and notebook execution. Developed secure pipelines to extract client audit data from Excel files on HTTPS servers, transform it, and automate loading into Azure SQL Database for reliable ingestion.