Summary
Overview
Work History
Education
Skills
Websites
Certification
Timeline
Generic

Mohammad Sunny

Senior Data Engineer
Gurgaon

Summary

Results-driven Senior Data Engineer with over 10.5 years of expertise in Big Data ecosystems, cloud data migration, and distributed data architecture. Proficient in Spark, PySpark, Kafka, Hive, AWS EMR, and Glue, with a strong track record of designing and implementing end-to-end data pipelines. Demonstrated ability to deliver scalable, data-driven solutions tailored to the unique needs of the BFSI, E-commerce, and Marketing sectors. Committed to leveraging advanced analytics to drive business insights and enhance operational efficiency.

Overview

11
11
years of professional experience
5
5
Certifications

Work History

Senior Data Engineer

Coforge
11.2024 - Current
  • Senior Data Engineer | Client: Santander UK | Project: Data Migration from on-premise to AWS
  • Migration of large-scale data pipelines from on-premise systems to AWS cloud environment ensuring high availability and performance.
  • Designed distributed workflows using Amazon EMR and AWS Glue.
  • Developed serverless ETL using AWS Lambda optimizing for cost and speed.
  • Created and orchestrated complex workflows using AWS Step Functions and EMR jobs.
  • Implemented monitoring via CloudWatch ensuring proactive issue resolution.
  • Enabled analytics via Athena reducing data retrieval times significantly.
  • Ensured secure data transfer using IAM roles, KMS encryption, and S3 policies.
  • Collaborated with cross-functional teams for migration strategy and validation.
  • Automated data validation and quality checks using Lambda scripts and Glue crawlers.
  • Optimized job performance on EMR and Glue achieving 60% reduction in processing time.

Senior Data Engineer

Iris Software
09.2020 - 11.2024
  • Senior Data Engineer | Client: Citi Bank | Project : Oversight
  • Created modules under project – QAF, BASEL, PEARL, FRM.
  • Written PySpark jobs using Spark-SQL under Ace Digital framework.
  • Designed and implemented scalable data architecture for banking compliance.
  • Developed ETL pipelines integrating data from Hive and Oracle ensuring reliability.
  • Optimized database performance and query response times.
  • Implemented encryption for secure financial data.
  • Performed root cause analysis for production issues.
  • Used GitHub Copilot for accelerated coding.

Senior Data Engineer

Accenture Pvt. Ltd
07.2019 - 09.2020
  • Senior Data Engineer | Client: Royal Bank of Scotland
  • Developed scalable, batch dynamic solutions for Terabyte-scale data.
  • Migrated data from SAS to AWS cloud in Spark using Python scripts.
  • Optimized Spark jobs and used MWAA (Airflow) for scheduling.
  • Validated data via Athena and resolved production issues using PySpark shell.

Data Engineer

Lumiq
06.2018 - 06.2019
  • Data Engineer | Clients: UGRO Capital, APH-China
  • Designed ETL/ELT data pipelines and ingestion using Apache Nii over S3
  • Transformed CSV files to parquet via AWS Lambda event triggers.
  • Performed Spark SQL transformations and built data lakes.
  • Implemented Vespa (real-time search engine) for recommendation systems using Docker and Kafka REST API.

Software Engineer / Android Developer

Ranosys & Retina Software
01.2015 - 01.2018
  • Created Android applications using Java/Kotlin.
  • Developed Spark Streaming and Kafka-based jobs for Wi-Fi analytics platform.
  • Lead code deployment and release management through Jenkins and Docker.

Education

M.Tech - Software Systems

BITS
Pilani
01.2023

B.Tech - Computer Science

Govt. Engg College
Ajmer
01.2014

XII & X - PCM

RBSE, Modern Sen. Sec. School
Sirohi
06.2008

Skills

  • Languages: Python, Java, Scala, Shell Scripting

  • Big Data: Apache Spark, PySpark, Kafka, Hive, HDFS, Airflow, Hue

  • Cloud: AWS EMR, Glue, Lambda, Athena, S3, Redshift

Certification

Timeline

Senior Data Engineer

Coforge
11.2024 - Current

Senior Data Engineer

Iris Software
09.2020 - 11.2024

Senior Data Engineer

Accenture Pvt. Ltd
07.2019 - 09.2020

Data Engineer

Lumiq
06.2018 - 06.2019

Software Engineer / Android Developer

Ranosys & Retina Software
01.2015 - 01.2018

M.Tech - Software Systems

BITS

B.Tech - Computer Science

Govt. Engg College

XII & X - PCM

RBSE, Modern Sen. Sec. School
Mohammad SunnySenior Data Engineer