Summary
Overview
Work History
Education
Skills
Certification
Technical Specializations
Tools And Software
Industry Expertise
Timeline
Generic

Sudeep Kumar Rout

Bengaluru

Summary

Skilled Data Engineer with 6 years of excellent track record in building scalable data pipelines, architecting data solutions, and processing large-scale datasets. Proficient in Python, Apache Spark, HDFS, and Druid, with a strong background in data transformation, optimization, and experience in handling high-volume datasets (~300GB/day) in telecom environments. Adept at creating robust, efficient, and maintainable data workflows in both on-premises and cloud environments. Experienced in collaboration with cross-functional teams to deliver high-quality solutions saving project costs by around 15% .

Overview

6
6
years of professional experience
1
1
Certification

Work History

Data Engineer | NOKIA

CGI
12.2024 - Current
  • Excelled in architecture reviews and implemented best practices in data governance and security.
  • Mastered 300 GB of data with a robust pipeline and engaged in end-to-end data flow.
  • Strengthened parallel Spark pipelines that improved data processing speed by 40%.
  • Achieved consistency in a team of junior engineers towards driving technical training in Azure services, boosting productivity by 30%.
  • Initiated and monitored data quality checks, validation layers, and job health metrics using custom Python scripts.
  • Automated segment compaction, segment granularity, and target compaction size bytes in Apache Druid using custom Python scripts to optimize query performance and reduce segment overhead.
  • Pioneered data integration solutions using Druid, decreasing data ingestion time by 40%.
  • Used various Spark transformations and actions for cleansing the input data.
  • Excelled and created a data pipeline that fetches and filters Kubernetes data, and transports that data to the Elasticsearch database.
  • Successfully deployed the application in K8S pods through CI/CD implementation using Helm charts.
  • Implemented CI/CD practices and version control using Git, and integrated with Airflow for orchestration.
  • Leveraged Docker containers to streamline environment consistency across development and production.

Production Support

Bell Canada
04.2020 - 04.2022
  • Application Support project, in Bell Canada and Supporting Applications 24/7.
  • Also involved in Analyzing customer problems, analysing the logs, creating scripts based on client requirement.

Mulesoft Developer

Airbus
09.2019 - 04.2020
  • Responsible for designing and connecting APIs that enable two applications to communicate with one another using the Mule connectors and to perform data Transformation.

Education

B. Tech - Mechanical Engineering

Gandhi Institute Of Engineering And Technology
Gunupur, Odisha

Skills

  • Kubernetes deployment
  • Data pipeline development
  • Python
  • SQL
  • Hadoop
  • Apache Spark

Certification

  • Unix
  • Python
  • Spark

Technical Specializations

  • Python
  • Apache Spark
  • PySpark
  • SQL

Tools And Software

  • VS Code
  • NiFi
  • Druid
  • Superset
  • JIRA
  • Jenkins
  • Azure
  • Airflow

Industry Expertise

  • Unix
  • SQL
  • Python
  • Hadoop
  • Apache Spark
  • Kubernetes

Timeline

Data Engineer | NOKIA

CGI
12.2024 - Current

Production Support

Bell Canada
04.2020 - 04.2022

Mulesoft Developer

Airbus
09.2019 - 04.2020

B. Tech - Mechanical Engineering

Gandhi Institute Of Engineering And Technology

Similar Profiles

CREATE PROFILE
Sudeep Kumar Rout