Animesh Kumar

Azure Data Engineering | Cloud Data Solutions

Roles and Responsibilities:

• Designed and implemented scalable Azure Data Factory (ADF) pipelines, integrating Azure Service Bus and Logic Apps to enable event-driven orchestration and real-time data workflows.
• Developed and optimized PySpark and SparkSQL solutions in Azure Databricks (ADB) for large-scale data transformations, analytics, and structured data modeling.
• Built and managed Databricks Notebooks, Stored Procedures, and SQL-based transformations to support KPI-driven business reporting across curated data layers.
• Implemented Unity Catalog in Azure Databricks to enforce object-level security and centralized access governance aligned with data mesh principles.
• Engineered high-performance ETL workflows to cut storage costs, speed up data availability, and scale pipeline efficiency.
• Designed and deployed data pipelines to load curated datasets into Snowflake, Azure SQL Database, and SQL Server Management Studio (SSMS) for structured warehousing and reporting solutions.
• Managed version control and CI/CD pipelines using Azure DevOps, Git, and Visual Studio Code to ensure production-grade deployments.
• Briefly leveraged Dagster for orchestration and DBT for modular SQL transformations in modernization initiatives.

Data Migration | ETL Development

Roles and Responsibilities:

• Supported cloud migration initiatives by building ingestion frameworks using Azure Data Factory and Databricks.
• Developed PySpark and SparkSQL scripts for incremental data processing and loading into Azure Data Lake.
• Built ingestion workflows in Apache Airflow and engineered validation pipelines using SQL, PL/SQL, and Python to ensure data quality for downstream analytics..
• Managed source control through Azure DevOps, GitHub, and Visual Studio Code to enable collaborative development.

System Administration | Incident Management

Roles and Responsibilities:

• Served as Queue Manager, overseeing ticket flow, delegation, and SLA compliance using ServiceNow.
• Generated and analyzed daily operational reports through Excel and ServiceNow dashboards.
• Troubleshot client-specific application issues and contributed to knowledge base (KB) development.