Manoj Kumar Reddy Gade
Data Engineer
Bangalore
Summary
With 3 years of professional experience, I bring expertise in Microservices, Big Data, and Hadoop technologies (PySpark, Python, Hive, HDFS, SQL, Azure). Skilled in developing scalable data-intensive applications, I possess a strong analytical and solution-oriented approach. My key strengths in delivering business-critical solutions are effective communication and cross-functional collaboration.
Overview
4
4
years of post-secondary education
3
3
years of professional experience
2
2
Certificates
Work History
Data Engineer
Wipro
Bangalore
09.2022 - Current
- Designed and developed end-to-end ETL pipelines using Azure Data Factory (ADF) to automate data ingestion from on-premises MySQL databases and FTP sources into Azure Data Lake Gen2
- Implemented incremental data loading with watermark tracking in Azure SQL Database, improving data freshness and reducing processing time
- Created external tables in Azure Synapse Analytics (PolyBase) and built data transformation flows for upsert operations, supporting real-time reporting and analytics
- Developed PySpark-based transformation scripts in Azure Databricks for high-performance data processing and analytics
- Ensured data integrity and optimized query performance by implementing partitioning and indexing strategies in Synapse and SQL databases
- Collaborated with cross-functional Agile teams, participated in daily stand-ups, code reviews, and unit testing, ensuring data reliability and accuracy
Education
Bachelor of Technology - Electrical, Electronics And Communications Engineering
Narasaropeta Engineering College
Guntur 06.2018 - 04.2022
Skills
PySpark
ETL development
Data pipeline design
Data modeling
Data warehousing
Performance tuning
Big data processing
Hadoop
SQL
Hive
HDFS
Timeline
Data Engineer
Wipro
09.2022 - Current
Bachelor of Technology - Electrical, Electronics And Communications Engineering
Narasaropeta Engineering College
06.2018 - 04.2022
Certification
Microsoft Certified: Azure Data Engineer Associate
Projects
eCommerce Data Platform
The eCommerce ecosystem consists of multiple applications and data systems. This project aims to build a centralized data platform to support reporting, analytics, and business insights. The solution involves four key layers: Landing Zone, Staging, Aggregation, and Visualization, ensuring seamless data ingestion, transformation, and accessibility for business users