Lekkala Brahmananda Reddy
Summary
Detail-oriented Data Engineer with nearly 7 years of experience in designing and deploying cloud-based data warehousing solutions. Developed and maintained scalable ETL/ELT pipelines in GCP and AWS, optimizing data workflows through native cloud services. Automated data extraction and complex transformations with Python scripts, while crafting SQL queries to support accurate reporting. Collaborated with technical teams to translate requirements into actionable architectures, ensuring data consistency and high availability.
Overview
7
7
years of professional experience
Work History
Data Engineer
CDS GLOBAL
Hyderabad
11.2023 - Current
- Implemented streaming ingestion for shipment and fulfillment events using Pub/Sub and Dataflow.
- Established batch and incremental ingestion pipelines using Cloud Storage, Cloud Composer, and BigQuery.
- Optimized PySpark and BigQuery workloads through partitioning, caching, and clustering for enhanced performance.
- Built transformation jobs on Dataproc to cleanse, standardize, deduplicate, and enrich operational datasets.
- Designed BigQuery reporting tables for KPIs including order status, shipment aging, and fulfillment SLA tracking.
- Developed GCP-based supply chain analytics platform for processing order, shipment, inventory, and return data, enhancing data accessibility and analysis.
- Orchestrated end-to-end workflows with Cloud Composer, streamlining dependency management and job alerting for improved operational efficiency.
- Collaborated with analysts and QA teams to validate KPI definitions and transformed datasets during UAT.
Data Engineer
Virtusa
02.2022 - 11.2023
- Designed and implemented end-to-end data solutions on AWS, utilizing key services for ingestion, storage, transformation, and analytics.
- Employed AWS Glue for data ingestion, transformation, and job scheduling, streamlining workflows and improving data accessibility.
- Implemented Amazon Redshift as a fully managed petabyte-scale warehouse for analytics.
- Utilized Amazon Athena for interactive querying of data stored in S3.
- Leveraged Amazon S3 for secure and scalable data storage solutions.
- Considered AWS Lambda for event-driven serverless processing and transformations.
- Collaborated with cross-functional teams to gather requirements and deliver actionable data-driven insights for strategic decision-making.
- Presented findings using Amazon QuickSight, enabling effective data visualization and facilitating informed decision-making.
Data Engineer
Cognizent
08.2021 - 01.2022
- Engineered end-to-end migration of legacy Pentaho PDI business logic into scalable AWS-native ETL/ELT pipelines using Python and advanced SQL.
- Developed complex orchestration workflows with AWS MWAA, incorporating strict dependency management and SLA monitoring.
- Stabilized production environments by implementing Airflow reliability patterns, reducing manual overhead through automation.
- Accelerated pipeline throughput by tuning data transformations and SQL execution plans for optimized performance.
- Reduced AWS Athena query scan costs by converting raw datasets into partitioned Parquet formats and optimizing query patterns.
- Enabled accurate billing and revenue reporting by ensuring data integrity and optimizing processing efficiency within new AWS architecture.
- Designed an observability framework with AWS Step Functions for real-time notifications and automated error handling, enhancing system reliability.
- Authored operational runbooks and architectural documentation to facilitate cross-team handovers and streamline onboarding processes.
Developer
EmblemHealth
08.2019 - 07.2021
- Collaborated with cross-functional teams to define and implement a unified event schema, improving data processing efficiency.
- Implemented AWS Global Accelerator for efficient and low-latency access to Kinesis streams from different regions.
- Conducted load testing and optimization to ensure the platform's scalability and reliability under peak workloads.
- Established encryption in transit and at rest, strengthening data security across the streaming pipeline.
- Implemented a comprehensive disaster recovery plan, ensuring continuity for the global streaming infrastructure.
Software Engineer
Hexaware
01.2019 - 08.2019
- Designed a real-time data streaming solution using AWS Kinesis for high-velocity data ingestion and processing.
- Collaborated with cross-functional teams to define and implement a unified event schema, enhancing data processing efficiency.
- Integrated streaming data with Redshift, enabling near real-time analytics for critical business decisions.
- Defined transformation logic and mapping documents, ensuring seamless data flow to consumption-ready objects.
- Established encryption in transit and at rest for enhanced security across the entire data pipeline.
- Monitored data product performance, providing recommendations for functional design and data quality enhancements.
Education
Bachelor of Technology (B. TECH) - Computer Science and Engineering
JNTU Kakinada
Skills
- Cloud services and data warehousing
- ETL processes and custom scripts
- Scripting and programming
- Database management
- Version control with Git
- Google Cloud Platform (BigQuery, Cloud Storage, Cloud SQL)
- AWS services (S3, Lambda, EMR, RDS, Redshift, Athena)
- Data modeling and workflow orchestration
- Batch processing and data integration tools (MuleSoft, Pentaho)
- Data visualization
Timeline
Data Engineer
CDS GLOBAL
11.2023 - Current
Data Engineer
Virtusa
02.2022 - 11.2023
Data Engineer
Cognizent
08.2021 - 01.2022
Developer
EmblemHealth
08.2019 - 07.2021
Software Engineer
Hexaware
01.2019 - 08.2019
Bachelor of Technology (B. TECH) - Computer Science and Engineering
JNTU Kakinada