SOMASAILOKESH UPPULURI
Data Engineer
Nidadavole,AP
Summary
Accomplished Data Engineer at Mphasis, adept at designing and optimizing scalable data pipelines with Scala and Apache Spark. Proven expertise in real-time streaming applications and ETL/ELT processes on Azure Databricks. Strong problem-solving skills ensure data quality and reliability, driving efficiency in high-volume data environments.
Overview
2
2
years of professional experience
2
2
Languages
Work History
Data Engineer
Mphasis
08.2023 - Current
- Designed, developed, and optimized scalable data pipelines using Scala and Apache Spark for batch and real-time processing.
- Built real-time streaming applications using Spark Structured Streaming to process high-volume data with low latency.
- Integrated Apache Kafka for reliable data ingestion, managing offsets, partitions, and consumer groups to ensure exactly-once or at-least-once processing.
- Developed and maintained ETL/ELT pipelines on Databricks, improving data processing efficiency and reliability.
- Monitored and debugged production data pipelines, ensuring data quality, consistency, and reliability.
- Worked with cloud-based data platforms to deliver secure, scalable, and production-ready data solutions.
Education
B.Tech - Electrical And Electronics Engineering
Sri Vasavi Engineering College
Pedatadepalli, Tadapalligudem, W.G, A.P 534101 04.2001 -
Skills
Programming: Scala
Timeline
Data Engineer
Mphasis
08.2023 - Current
B.Tech - Electrical And Electronics Engineering
Sri Vasavi Engineering College
04.2001 -