Sanjeev K
Bengaluru
Summary
Data Engineer specializing in building and optimizing ETL pipelines with Python, SQL, and PySpark. Delivered scalable data solutions and enhanced performance through expertise in Azure Databricks, Azure Data Factory, Apache Spark, and Delta Lake. Managed data operations focusing on pipeline monitoring, incident resolution, and root cause analysis, ensuring reliability in production systems.
Overview
5
5
years of professional experience
8
8
Certifications
Work History
Associate Data Engineer
Lingaro india pvt lmt
Bangalore South
05.2024 - 03.2026
- Built and orchestrated data pipelines using Azure Data Factory and Databricks, implementing Delta Lake (CDC, MERGE) for incremental processing and data reliability.
- Designed and built scalable ETL pipelines using PySpark, Python, and SQL, processing large-scale datasets and improving performance by 20–30%.
- Developed and optimized complex queries using T-SQL and PostgreSQL for efficient data transformation and validation.
- Supported scalable data ingestion and analytics workflows in multi-cloud environments with AWS (S3) and GCP (BigQuery/Cloud Storage).
- Generated comprehensive reports to support decision-making.
Technical Support Executive
Tesco
Bangalore South
07.2023 - 12.2023
- Provided technical support for customers via phone and online chat.
- Troubleshot software and hardware issues efficiently to resolve customer queries.
- Resolved system and operational issues to minimize downtime and improve performance.
- Analyzed data using Excel to create reports that informed operational decisions.
- Documented customer interactions and solutions in the support ticketing system.
Customer Support Executive
Accenture
Bangalore
07.2021 - 06.2022
- Managed customer inquiries through phone and chat support channels.
- Resolved customer issues efficiently while meeting SLA and quality standards.
- Investigated customer complaints and provided effective solutions.
- Documented customer interactions in CRM software with accuracy.
Education
Master of Science - Data Science
SRM University
India05-2025
Bachelor of Science - Computer Applications Development
Bangalore University
India04-2021
Skills
- Programming & Query Languages:
Python, Advanced SQL, T-SQL - Big Data & Processing:
PySpark, Apache Spark, Delta Lake, Distributed Systems, Big Data Processing - Cloud Platforms:
Microsoft Azure (ADF, Databricks), AWS (S3, Glue, Databricks), Google Cloud Platform (BigQuery) - Data Engineering & ETL:
ETL Pipelines, Data Pipeline Optimization, Performance Tuning, Data Modeling, Data Warehousing Concepts - Data governance
- Data Operations & Processing Techniques:
CDC (Change Data Capture), MERGE, Incremental Processing, Pipeline Monitoring, SLA Management - Orchestration & Tools:
Apache Airflow, ServiceNow - Databases:
PostgreSQL - Visualization & Reporting:
Power BI, Tableau, Advanced Excel
Languages
English
Proficient (C2)
C2
Certification
IBM Data Analyst certificate
Projects
- Cloud Data Ingestion & Transformation Pipeline
Built ETL pipelines using ADF & Databricks with Bronze–Silver–Gold architecture.
- Incremental Data Processing with Delta Lake
Implemented CDC, MERGE, and watermarking to improve processing efficiency.
- Production-Ready Data Pipelines & Monitoring
Developed SLA tracking, alerting, and incident management using ServiceNow.
- Data Governance & Cataloging Implementation
Implemented Unity Catalog for data lineage and access control.
- OSA(on-shelf availability) project in lingaro sp zoo for building ETL pipelines
• Built and maintained ETL pipelines with Bronze–Silver–Gold architecture using ADF & Databricks
• Implemented monitoring, alerting, and SLA tracking for production pipelines
• Designed incremental data processing (CDC, MERGE) for efficient data handling
• Managed Delta Lake tables ensuring ACID compliance and high availability
• Supported data pipelines by troubleshooting failures and optimizing performance
Internships
Data analyst – IBM 12 Months
Analyzed datasets to identify trends and improve decision-making by 15%.
Built reports and streamlined data processes, reducing data retrieval time by 20%.
Associate Data Engineer – Databricks 12 Months
Built end-to-end ETL pipelines using PySpark, Spark SQL, and Delta Lake on Azure.
Implemented incremental data processing (CDC, MERGE) and ensured SLA-driven pipeline monitoring.
Timeline
Associate Data Engineer
Lingaro india pvt lmt
05.2024 - 03.2026
Technical Support Executive
Tesco
07.2023 - 12.2023
Customer Support Executive
Accenture
07.2021 - 06.2022
Master of Science - Data Science
SRM University
Bachelor of Science - Computer Applications Development
Bangalore University