Bhanu Prakash Reddy Manne
Data Engineer
Hyderabad,TS
Summary
Detail-oriented Data Engineer with extensive experience in designing scalable data solutions and automating workflows. Demonstrated success in performance tuning and implementing data quality frameworks that ensure reliable analytics and reporting.
Overview
3
3
years of professional experience
Work History
Data Engineer
Warner Bros
01.2025 - Current
- Designed and developed scalable data engineering solutions for batch and streaming data processing to support enterprise analytics and business reporting.
- Built and maintained ETL/ELT pipelines using Python, PySpark, SQL, and Apache Spark for processing large-scale datasets.
- Developed event-driven data processing workflows to ingest, transform, and deliver data across multiple business applications.
- Optimized distributed Spark jobs, improving processing performance, and reducing overall execution time.
- Implemented data quality frameworks, including schema validation, null checks, reconciliation, and automated data validation.
- Collaborated with data scientists, analysts, and business stakeholders to deliver clean, reliable, and accessible datasets for analytics and machine learning use cases.
- Designed and maintained a scalable data lake architecture on AWS S3 for structured and semi-structured data.
- Automated data engineering workflows using Apache Airflow, and integrated CI/CD pipelines using Jenkins.
- Built reusable data transformation components and standardized ETL processes to improve maintainability and scalability.
- Integrated data from relational databases, APIs, and enterprise source systems into centralized data platforms.
- Monitored and resolved production data pipeline failures, ensuring high availability and timely SLA delivery.
- Participated in on-call production support and root cause analysis for critical data platform issues.
- Worked in Agile (Scrum) teams, participating in sprint planning, code reviews, and release activities.
- Documented data models, transformation logic, and technical specifications for cross-functional teams.
- Applied data partitioning, caching, and query optimization techniques to improve Spark job performance.
- Assisted in monitoring cloud resource utilization, and optimizing compute and storage costs for data workloads.
- Supported data governance initiatives by implementing security, access controls, and data quality standards.
- Contributed to the scalable data platform development, supporting advanced analytics, reporting, and AI-driven use cases.
Data Engineer
SAS2PY
09.2023 - 11.2024
- Designed and implemented scalable ETL pipelines using AWS Glue and Apache Spark to ingest structured and semi-structured data into Amazon S3 data lakes.
- Optimized data transformation workflows with Python, PySpark, and SQL for insurance risk analytics, and financial reporting. Migrated over 8,000 lines of legacy SAS code to PySpark, enhancing performance by approximately 75%, and enabling cloud scalability.
- Processed large-scale datasets utilizing Apache Spark and Iceberg tables in distributed cluster environments.
- Executed comprehensive data quality checks, including null validation, schema validation, reconciliation, and unit-level testing.
- Integrated validation frameworks into CI/CD pipelines using Jenkins to ensure reliable deployments and automated testing.
- Centralized data lake architecture integrates data from on-premise systems, cloud platforms, and third-party APIs.
- Collaborated with analysts, finance stakeholders, and senior engineers in agile environments to meet business SLAs.
Education
B.Tech - Electronics And Communications Engineering
Institute of Aeronautical Engineering
Hyderabad, India 04.2001 -
Skills
ETL development
Data pipeline design
Data migration
Data warehousing
SQL expertise
Data quality assurance
Scripting languages
Performance tuning
Problem-solving
Timeline
Data Engineer
Warner Bros
01.2025 - Current
Data Engineer
SAS2PY
09.2023 - 11.2024
B.Tech - Electronics And Communications Engineering
Institute of Aeronautical Engineering
04.2001 -