Kavipreth TS
Tiruchengode
Summary
Results-driven Data Engineer with 4 years of experience specializing in Azure Databricks, PySpark, and Data Engineering pipelines. Skilled in designing and implementing scalable data solutions, ETL/ELT pipelines, and real-time streaming systems. Strong expertise in Azure Data Lake, Delta Lake and CI/CD automation. Adept at collaborating with cross-functional teams to deliver high-quality, business-driven data solutions.
Overview
5
5
years of professional experience
1
1
Certification
Work History
Senior Analyst
Capgemini
Bangalore
01.2021 - Current
- Designed and developed ETL pipelines in Azure Databricks using PySpark and Delta Lake to process 1TB+ of daily data.
- Implemented streaming data pipelines with Spark Structured Streaming and Azure Event Hubs for real-time analytics.
- Built data ingestion frameworks from multiple sources (SQL, Blob, REST APIs, and Kafka) into ADLS Gen2.
- Developed Delta Live Tables (DLT) pipelines for incremental processing and schema evolution.
- Collaborated with BI teams to create data marts in Synapse Analytics for Power BI reporting.
- Automated workflows with Azure Data Factory (ADF) and monitored performance with Databricks Jobs.
- Improved query performance by optimizing Spark jobs (partitioning, caching, and broadcast joins).
- Migrated on-premises ETL pipelines to Azure Data Lake and Databricks.
- Developed batch pipelines to process structured and semi-structured data (Parquet, JSON, CSV).
Education
Bachelor of Technology - Mechanical Engineering
SRM Institute of Science And Technology
TamilNadu, India05.2021
Skills
- My SQL
- ETL development
- Data ingestion
- Spark Structured Streaming
- Delta Lake
- Python
- Data warehousing
- Azure Databricks
Personal Information
Title: Software Engineer
Certification
DataBricks Certified DataEngineer Associate
Timeline
Senior Analyst
Capgemini
01.2021 - Current
Bachelor of Technology - Mechanical Engineering
SRM Institute of Science And Technology
Similar Profiles
Mohammed Rabic RiyazudeenMohammed Rabic Riyazudeen
Senior Applications Consultant at CapgeminiSenior Applications Consultant at Capgemini
Aradhana SinhaAradhana Sinha
Senior Consultant at CapgeminiSenior Consultant at Capgemini
Shivansh GuptaShivansh Gupta
.Net Full Stack Developer at Capgemini.Net Full Stack Developer at Capgemini
Thierry MaurelThierry Maurel
Engagement Manager at CAPGEMINIEngagement Manager at CAPGEMINI
Suresh ASuresh A
Regional Credit Manager at ICICI BANKRegional Credit Manager at ICICI BANK