Summary
Overview
Work History
Education
Skills
Declaration
Timeline
Generic
Rahul Sakthi

Rahul Sakthi

Data Engineer
Bengaluru

Summary

Results-driven Data Engineer at Societe Generale Global Solution Center, skilled in Scala and Python. Successfully optimized ETL pipelines and automated processes, enhancing team productivity. Developed a robust Data Ingestion Framework with Apache Spark, ensuring data integrity and quality. Strong collaborator with a focus on innovative solutions and efficient database design.

Overview

3
3
years of professional experience

Work History

Data Engineer

Societe Generale Global Solution Center
Bengaluru
08.2022 - Current
  • Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
  • Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
  • Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors.
  • Created a generic Data Ingestion Framework using Apache Spark that ingests data in various formats into the Data Lake.
  • Perform parsing of unstructured daily usage user logs and ingest it into current usage.
  • Developed and designed an automated non-regression test generic framework using Apache Spark, Scala, Hive, and Spark-SQL, which automatically creates a series of data checks to execute, reducing manual effort.
  • Established the process of production monitoring by implementing automated status reports, notifications, etc.

Education

Bachelor's of Engineering - Electronics And Instrumentation Engineering

Madras Institute of Technology (MIT)
Chennai, India
04.2001 -

Skills

Programming Languages: Scala, Python, Spark-Sql (DSL)

Hadoop Ecosystem: HDFS, Hive, Oozie, Sqoop, YARN, Kafka, Airflow, HBase, Apache Spark, AWS S3, Spark ML, PySpark

DevOps: Jenkins, Ansible, GitHub Actions, SonarQube

Databases: Cosmos, PostgreSQL, MySQL, Hive

Declaration

All information in this resume is right and truthful to the best of my knowledge and faith.

Rahul Sakthi
Bengaluru, India

Timeline

Data Engineer

Societe Generale Global Solution Center
08.2022 - Current

Bachelor's of Engineering - Electronics And Instrumentation Engineering

Madras Institute of Technology (MIT)
04.2001 -
Rahul SakthiData Engineer