NITIN KHEDEKAR

Microsoft Corporation Project: Risk Data Platform Project: Marketplace Insights

Role: Azure Data Engineer / Azure Platform Engineer

Key Responsibilities & Achievements

• Deployed Azure Data Factory (ADF) pipelines and Azure Function Apps using the EV2 deployment framework.
• Performed Azure subscription decommissioning and migration, ensuring smooth transition and governance of cloud resources.
• Executed Azure Key Vault migration while preserving existing RBAC roles and access configurations.
• Developed Auto List and Manual List services:
  OneBranch pipelines for manual list uploads.
  Azure Synapse pipelines for automated list ingestion and processing.
• Designed and implemented FS3 pipelines for large-scale data processing.
• Built monitoring and alerting systems for critical data pipelines using Azure Monitor and Log Analytics.
• Integrated telemetry and logging using Application Insights, Log Analytics, Kusto (KQL), Event Hubs, and Azure Diagnostics.
• Developed Power BI dashboards for ADF and Synapse pipeline monitoring, enabling tracking of pipeline executions, failures, and performance metrics.
• Built Geneva dashboards to monitor critical pipeline executions and operational health.
• Developed Grafana dashboards to visualize pipeline metrics, logs, and operational insights from monitoring systems.
• Created Classic Release Pipelines and migrated deployments to OneBranch CI/CD pipelines.
• Automated Azure resource provisioning and management using NSP automation, covering:
  Storage Accounts
  Log Analytics Workspaces
  Azure Key Vault
  Azure SQL Server
  Cosmos DB
• Implemented Infrastructure as Code (IaC) using Bicep templates for automated Azure resource deployment.
• Built monitoring systeme for resource creation, updates, deletion across Azure environments.
• Improved security posture by:
  Disabling local authentication for Storage Accounts and Function Apps.
  Creating Function Apps With Zip Package deployment without storage account keys.
• Used Visual Studio Code with GitHub Copilot to accelerate development and maintain code quality.
• Resolved S360 security compliance items to ensure adherence to Microsoft security standards.
• Enhanced Azure Synapse pipelines to improve performance, scalability, and data processing efficiency.
• Worked on CRI and LSI Incidents, supporting data processing and analytics workflows for marketplace insights.

• Developed Pipeline for DATA Movement from HDFS to SRZ for historical load.
• Developed ingestion Pipeline for ongoing files to SRZ.
• Developed the ETL using Azure Data Factory and Data bricks with a metadata driven approach which loads data from SRZ Files to synapse warehouse by implementing business logic for historical load and incremental load.
• Designing and Implementing SQL server database and Azure SQL database.
• Analyzing Source Data and as per requirement generating the same table in target destination.
• Writing complex T-SQL queries, Views, Stored Procedure and Functions using Joins, Sub queries, Correlated Sub queries and CTE’s.
• Optimizing slow performing queries/ stored procedures.
• Implementation of Azure CI/CD.
• Application monitoring and production support.

• Developed API using AWS API Gateway console and using CDK code with AWS IAM and API key authorization. Analyze requirements and decide resources, path parameters and query string parameters.
• Developed AWS lambda for API.
• Developed Jupyter Notebooks for API calls.

• Developed Pipeline for DATA Movement from Oracle, My SQL, Amazon RDS to Snowflake for historical load.
• Developed the ETL using Azure Data Factory with a metadata driven approach which loads data from Oracle, My SQL, Amazon RDS, Various API, Sales force to Snowflake warehouse by implementing business logic for historical load and incremental load.
• Designing and Implementing SQL server database and Azure SQL database.
• Analyzing Source Data and as per requirement generating the same table in target destination.
• Writing complex T-SQL queries, Views, Stored Procedure and Functions using Joins, Sub queries, Correlated Sub queries and CTE’s.

• Developed SSIS Packages to load data from various files to SQL server with business logic.
• Designing and Implementing SQL server database objects.
• Deploying and Scheduling SSIS Packages.
• Writing complex T-SQL queries, Views, Stored Procedure and Functions using Joins, Sub queries, Correlated Sub queries and CTE’s.

• Developed SSIS Packages to load data from various files to SQL server with business logic.
• Designing and Implementing SQL server database objects.
• Deploying and Scheduling SSIS Packages.
• Writing complex T-SQL queries, Views, Stored Procedure and Functions using Joins, Sub queries, Correlated Sub queries and CTE’s.