

IT professional with over 4+ years of IT experience, including 3.5+ years specializing in Azure Data Engineering. Skilled in designing, building, and improving scalable data pipelines and cloud data platforms on Microsoft Azure. Proven track record of delivering high-performance, secure, and cost-effective data solutions that support analytics and business intelligence.
• Designed and developed end-to-end data pipelines to ingest data from multiple source systems, including Relational databases, CSV, Excel, JSON, SQL tables, and REST APIs into ADLS Gen2 and Azure Blob Storage in Parquet format using Azure Data Factory (ADF).
• Built and maintained ADF pipelineswith parameterisation, triggers, and dynamic datasets to support full and incremental data loads.
• Implemented pipeline monitoring, logging, and alerting (ADF + custom frameworks) to ensure SLA adherence and proactive resolution.
• Developed advanced transformationsin Databricks using PySpark and SQL for cleansing, joinsand data quality checks.
• Managed Databricks Jobsand Clusters for orchestration, autoscaling, and cost-optimized execution, while enforcing governance via Unity Catalog.
• Utilized Azure DevOps for version control and implemented CI/CD pipelines to automate build, test, and deployment processes, ensuring streamlined and reliable data workflows.
• Collaborated with stakeholders, analysts, and BI teams to deliver high-quality datasets for reporting and dashboards.
Cloud & Data Engineering: Azure Data Factory, Azure Databricks, ADLS Gen2, Azure Blob Storage, Azure Key Vault, Azure SQL
Big Data & Processing: Azure Databricks, PySpark
Databases & Management tool: Azure SQL, SQL Server management studio
Programming: Pyspark,SQL,Python (Basics)
Data Formats: Parquet, JSON, CSV, Avro
DevOps & Governance: Azure Devops, CI/CD, Unity Catalog
Ticketing tool: ServiceNow