Mohammad Sunny
Senior Data Engineer
Gurgaon
Summary
Results-driven Senior Data Engineer with over 10.5 years of expertise in Big Data ecosystems, cloud data migration, and distributed data architecture. Proficient in Spark, PySpark, Kafka, Hive, AWS EMR, and Glue, with a strong track record of designing and implementing end-to-end data pipelines. Demonstrated ability to deliver scalable, data-driven solutions tailored to the unique needs of the BFSI, E-commerce, and Marketing sectors. Committed to leveraging advanced analytics to drive business insights and enhance operational efficiency.
Overview
11
11
years of professional experience
5
5
Certifications
Work History
Senior Data Engineer
Coforge
11.2024 - Current
- Senior Data Engineer | Client: Santander UK | Project: Data Migration from on-premise to AWS
- Migration of large-scale data pipelines from on-premise systems to AWS cloud environment ensuring high availability and performance.
- Designed distributed workflows using Amazon EMR and AWS Glue.
- Developed serverless ETL using AWS Lambda optimizing for cost and speed.
- Created and orchestrated complex workflows using AWS Step Functions and EMR jobs.
- Implemented monitoring via CloudWatch ensuring proactive issue resolution.
- Enabled analytics via Athena reducing data retrieval times significantly.
- Ensured secure data transfer using IAM roles, KMS encryption, and S3 policies.
- Collaborated with cross-functional teams for migration strategy and validation.
- Automated data validation and quality checks using Lambda scripts and Glue crawlers.
- Optimized job performance on EMR and Glue achieving 60% reduction in processing time.
Senior Data Engineer
Iris Software
09.2020 - 11.2024
- Senior Data Engineer | Client: Citi Bank | Project : Oversight
- Created modules under project – QAF, BASEL, PEARL, FRM.
- Written PySpark jobs using Spark-SQL under Ace Digital framework.
- Designed and implemented scalable data architecture for banking compliance.
- Developed ETL pipelines integrating data from Hive and Oracle ensuring reliability.
- Optimized database performance and query response times.
- Implemented encryption for secure financial data.
- Performed root cause analysis for production issues.
- Used GitHub Copilot for accelerated coding.
Senior Data Engineer
Accenture Pvt. Ltd
07.2019 - 09.2020
- Senior Data Engineer | Client: Royal Bank of Scotland
- Developed scalable, batch dynamic solutions for Terabyte-scale data.
- Migrated data from SAS to AWS cloud in Spark using Python scripts.
- Optimized Spark jobs and used MWAA (Airflow) for scheduling.
- Validated data via Athena and resolved production issues using PySpark shell.
Data Engineer
Lumiq
06.2018 - 06.2019
- Data Engineer | Clients: UGRO Capital, APH-China
- Designed ETL/ELT data pipelines and ingestion using Apache Nii over S3
- Transformed CSV files to parquet via AWS Lambda event triggers.
- Performed Spark SQL transformations and built data lakes.
- Implemented Vespa (real-time search engine) for recommendation systems using Docker and Kafka REST API.
Software Engineer / Android Developer
Ranosys & Retina Software
01.2015 - 01.2018
- Created Android applications using Java/Kotlin.
- Developed Spark Streaming and Kafka-based jobs for Wi-Fi analytics platform.
- Lead code deployment and release management through Jenkins and Docker.
Education
M.Tech - Software Systems
BITS
Pilani01.2023
B.Tech - Computer Science
Govt. Engg College
Ajmer01.2014
XII & X - PCM
RBSE, Modern Sen. Sec. School
Sirohi06.2008
Skills
- Languages: Python, Java, Scala, Shell Scripting
- Big Data: Apache Spark, PySpark, Kafka, Hive, HDFS, Airflow, Hue
- Cloud: AWS EMR, Glue, Lambda, Athena, S3, Redshift
Certification
Timeline
Senior Data Engineer
Coforge
11.2024 - Current
Senior Data Engineer
Iris Software
09.2020 - 11.2024
Senior Data Engineer
Accenture Pvt. Ltd
07.2019 - 09.2020
Data Engineer
Lumiq
06.2018 - 06.2019
Software Engineer / Android Developer
Ranosys & Retina Software
01.2015 - 01.2018
M.Tech - Software Systems
BITS
B.Tech - Computer Science
Govt. Engg College
XII & X - PCM
RBSE, Modern Sen. Sec. School