Hi, I’m
Nikhil Madeppa
Hyderabad
Summary
Senior Data Engineer with expertise in GCP and Databricks, specializing in building scalable ETL/ELT pipelines and optimizing storage costs using BigQuery and Delta Lake. Proven track record of processing millions of records daily and improving pipeline performance by 30% through advanced Spark tuning and cloud-native architecture.
Overview
4
years of professional experience
3
Certification
Work History
StateStreetHyderabad, Telangana, India
Senior Associate
03.2024 - 12.2025
Job overview
- Designed a Proof-of-Concept (PoC) for migrating legacy on-prem billing logic to Google BigQuery, demonstrating a 40 percent reduction in query execution time using partitioning and clustering strategies.
- Developed Python scripts to interact with Google Cloud Storage (GCS) APIs for automated report archival and retrieval.
- Built and optimized daily billing data pipelines on Databricks using PySpark, processing millions of records for downstream reporting.
- Reduced pipeline runtime by 30 percent by tuning Spark configurations (executor memory, shuffle partitions) and utilizing disk caching.
StateStreetHyderabad, Telangana, India
Associate 2
07.2022 - 03.2024
Job overview
- Architected a high-velocity ingestion pipeline to load 20M+ records from external systems in under 10 minutes, optimizing for high throughput and minimal latency.
- Automated recurring manual data reconciliation tasks using Shell Scripting and SQL, reducing firewall operational dependency by 90 percent.
- Resolved critical client reporting delays by analyzing execution plans and refactoring complex SQL queries, resulting in improved SLAs.
- Developed parameterized stored procedures to scale data extraction logic, paving the way for future migration to cloud-native orchestration tools.
StateStreetHyderabad, Telangana, India
Application Developer - Intern
01.2022 - 06.2022
Job overview
- Collaborated with QA and development teams to triage UAT issues, focusing on ORMB-related data integrity and validation.
- Scheduled and monitored batch jobs, gaining exposure to ETL pipeline timing and dependencies.
- Assisted in debugging billing data anomalies by querying client invoice tables using SQL.
Education
VNR Vignana Jyothi Institute of Engineering and TechnologyHyderabad, Telangana, India
Bachelor of Technology from Computer Science and Engineering
06.2022
University Overview
GPA: 8.4
Skills
- Cloud Platform: Google Cloud Platform(GCP), Amazon Web Services(AWS)
- GCP Services: BigQuery, Cloud Storage (GCS), Cloud Dataflow, Cloud Composer (Airflow), Cloud Functions, Pub/Sub
- Data Engineering: Databricks, PySpark, Delta Lake, Snowflake
- Programming: Python, SQL, PL/SQL, Shell Scripting
- Databases: Google BigQuery, Redshift, Oracle, MySQL
- DevOps Tools: Git, Jira
Certification
• SnowPro Core Certification by Snowflake
• Databricks Data Engineer Associate
• Problem Solving using Data Structures and Algorithms - Smart Interviews
Timeline
Senior Associate
StateStreet
03.2024 - 12.2025
Associate 2
StateStreet
07.2022 - 03.2024
Application Developer - Intern
StateStreet
01.2022 - 06.2022
VNR Vignana Jyothi Institute of Engineering and Technology
Bachelor of Technology from Computer Science and Engineering