Results-driven Data Engineer with 3.5 years of experience architecting scalable Azure Lakehouse solutions. Skilled in orchestrating ETL/ELT pipelines using Azure Data Factory and processing big data with Azure Databricks (PySpark/SQL). Proven expertise in implementing Medallion Architecture, automating data pipelines with Delta Lake, and delivering Power BI dashboards for actionable insights.
Overview
3
3
years of professional experience
1
1
Certification
Work History
ENGINEER II - SOFTWARE DEVELOPMENT
Verizon
Chennai
07.2023 - Current
Automated end-to-end ingestion workflows with ADF triggers and Databricks Workflows, enabling continuous real-time streaming and enhancing data accessibility.
Developed high-performance Spark notebooks in Databricks, achieving significant reductions in processing times through optimization techniques.
Engineered dimensional data models and optimized Delta tables, contributing to a cohesive enterprise analytics platform that supports data-driven decision-making.
Implemented Medallion Architecture in Delta Lake to ensure ACID compliance and enforce schema consistency.
Collaborated with stakeholders to translate complex business requirements into technical architectures using ADF, Databricks, and ADLS Gen2, ensuring project alignment with business goals.
Established data validation frameworks with Databricks Expectations to uphold 99.9% data integrity.
Architected and managed scalable ETL/ELT pipelines in Azure Data Factory and Databricks for efficient data movement across multi-petabyte datasets.
ASSISTANT SYSTEM ENGINEER
Tata Consultancy Services
Chennai
08.2022 - 06.2023
Executed end-to-end monitoring and performance validation for product launches, ensuring alignment with KPIs and SLAs to achieve successful outcomes.
Managed incident response processes, maintaining operational readiness to minimize disruption during product launches.
Developed SQL-driven dashboards and automated reporting solutions, improving metric visibility and decision-making during product rollouts.
Conducted real-time system analysis using APM and observability tools, enabling rapid triage and resolution of production issues.
Education
B.E - Computer Science And Engineering
Panimalar Engineering College
Chennai, India
06.2022
HSSC -
DAV Senior Secondary School
Chennai, India
04.2018
SSLC -
DAV Senior Secondary School
Chennai, India
04.2016
Skills
Programming: SQL, Python
Cloud Services: Microsoft Azure, Azure Data Factory,Azure Databricks, Azure SQL
Data Engineering: ETL/ELT Pipelines, Data Modeling, Data Quality