SOMASAILOKESH UPPULURI - Data Engineer - Mphasis

Summary

Accomplished Data Engineer at Mphasis, adept at designing and optimizing scalable data pipelines with Scala and Apache Spark. Proven expertise in real-time streaming applications and ETL/ELT processes on Azure Databricks. Strong problem-solving skills ensure data quality and reliability, driving efficiency in high-volume data environments.

Overview

2

years of professional experience

2

Languages

Work History

Data Engineer

Mphasis

08.2023 - Current

Designed, developed, and optimized scalable data pipelines using Scala and Apache Spark for batch and real-time processing.
Built real-time streaming applications using Spark Structured Streaming to process high-volume data with low latency.
Integrated Apache Kafka for reliable data ingestion, managing offsets, partitions, and consumer groups to ensure exactly-once or at-least-once processing.
Developed and maintained ETL/ELT pipelines on Databricks, improving data processing efficiency and reliability.
Monitored and debugged production data pipelines, ensuring data quality, consistency, and reliability.
Worked with cloud-based data platforms to deliver secure, scalable, and production-ready data solutions.

Education

B.Tech - Electrical And Electronics Engineering

Sri Vasavi Engineering College

Pedatadepalli, Tadapalligudem, W.G, A.P 534101

04.2001 -

Skills

Programming: Scala

Big Data: Apache Spark, Spark Structured Streaming

Messaging: Apache Kafka (Offsets, Partitions, Consumer Groups)

Cloud Platform: Microsoft Azure

Data Platform: Azure Databricks

DevOps: Azure DevOps, CI/CD Pipelines

Data Processing: Batch Processing, Real-Time Streaming, ETL/ELT