Open To Work
DILEEP KUMAR CHIGURUVADA
Bengaluru
Work Preference
Summary
Dynamic Senior Engineering Manager with extensive experience at Cloudera, specializing in SQL optimization and team leadership. Successfully enhanced data warehouse performance, achieving a 20% improvement in query efficiency. Proven track record in managing cross-functional teams and deploying containerized solutions using Kubernetes and Rancher, driving innovation and operational excellence.
Overview
19
19
years of professional experience
Work History
Senior Engineering Manager
Cloudera
Bengaluru
02.2025 - Current
- Vast experience in the Big Data space and worked many years on distributing Cloudera CDP Stack with defined expertise on SQL engines like Hive Impala, Storage like HDFS and Ozone and Security Data Governance components like Ranger and Atlas At Cloudera.
- Lead a 20‑engineer squad across performance, Quality and platform disciplines, delivering enterprise‑grade Data warehousing Product (Hive, Impala, and Trino engines), Data Engineering Solution(Spark) and Cloudera AI (Workbench) platform that serve 500+ global customers. Established a performance‑tuning framework: Hive‑Tez vs Hive‑LLAP benchmarks, runtime CBO, cache tuning, and spill‑to‑disk heuristics.Integrated Iceberg across engines, enabling ACID compliance and schema evolution, lowering storage costs and improving query performance by 20%.
- I lead efforts to enhance the performance, scalability, and security of Cloudera Data Warehouse (CDW) engines, including Hive, Impala, and Trino, with Iceberg integration on cloud and on-premise platforms.
- Deployed a container‑native monitoring & logging stack (Prometheus, Grafana, Fluentd, OpenTelemetry) that cut incident response time by 40 %.In-house K8S Observability Tool (developed by my Team) which gives 100% accurate metrics and anomalies
- Mentored junior engineers to enhance technical skills and foster professional growth.
- Researched and conceptualized data analysis methods, leading to improved reliability and manufacturability of measurement tools.
Senior Engineering Manager
Cloudera
Atlanta
05.2023 - 01.2025
- Led performance and quality engineering team to evaluate and enhance data warehousing components, improving overall system reliability.
- Managed containerization stacks using Kubernetes, Rancher, and OpenShift, supporting seamless deployment and scaling.
- Directed team validating Cloudera Lakehouse Optimizer for Iceberg features, ensuring accurate functionality of snapshots.
- Optimized Hive and Impala query performance using various strategies like CBO at runtime.
- Collaborated with the development team to certify SQL engines for enterprise readiness in containerized environments.
- Focused on table maintenance activities and core functionalities, such as equality deletes.
Engineering Manager
Cloudera
Bengaluru
10.2019 - 05.2023
- Managed quality for Cloudera Data Warehouse product, enhancing reliability of hybrid data cloud solutions.
- Executed CDP stack upgrades, mitigating data loss scenarios through targeted resolutions.
- Supported Zero Downtime Upgrade (ZDU) on CDP stack, facilitating seamless transitions for users.
- Facilitated on-premises customer access to compute resources on AWS and Azure nodes as containerized service using CDW.
Staff Software Engineer
Cloudera
Bengaluru
01.2019 - 09.2019
Staff Software Engineer
Hortonworks
Bengaluru
05.2017 - 09.2019
- Validated critical features for Hive and Impala, including CatalogD Cache, Hive LLap, Hive concurrency, HMS APIs, and Impala cache Spill to Disk, contributing to robust performance
- Led quality engineering initiatives for Hive and Impala projects, ensuring high standards and reliability
- Integrated Druid testing framework into existing CI/CD processes, enhancing test coverage and efficiency
Senior SDET
Hortonworks
Bengaluru
06.2014 - 05.2017
- Developed automated test frameworks for big data applications, improving test coverage and reliability.
- Created scale tests for Sqoop and Flume components, ensuring data integrity during data transfer.
- Validated Hive ACID features, confirming data transaction reliability and consistency.
Software Engineer
IBM India Software Labs (ISL)
Bengaluru
04.2010 - 06.2014
- Developed and maintained IBM TXSeries for Multi platforms, a transaction processing middleware, supporting CICS and Encina components across AIX, Windows, Solaris, HP, and Linux platforms.
- Developed software applications for enterprise solutions at IBM India Software Labs.
- Provided COBOL and C runtime support for transaction management system within WebSphere Application Server
- Collaborated with cross-functional teams to gather requirements and design applications.
- Conducted code reviews to ensure quality and adherence to best practices.
SOFTWARE ENGINEER
Aricent
Bengaluru
02.2008 - 04.2010
- Developed protocol testing simulator to enhance testing accuracy.
- Conducted performance engineering tests to identify system efficiency bottlenecks.
Education
Bachelor of Engineering - BE - Computer Engineering
JNTUA College of Engineering
Anantapur01-2007
SSC - Englishh Maths Science Social studies
SANGHAMITRA VIDYALAYAM
01-2001
ST Marys English Medium High School
Naidupeta01-1998
Skills
- Data warehousing
- Data Warehouse Optimization
- SQL optimization
- Big data technologies
- Kubernetes Orchestration
- Container orchestration
- Cloud deployment
- Team leadership
- Cross-functional team management
Languages
English
Timeline
Senior Engineering Manager
Cloudera
02.2025 - Current
Senior Engineering Manager
Cloudera
05.2023 - 01.2025
Engineering Manager
Cloudera
10.2019 - 05.2023
Staff Software Engineer
Cloudera
01.2019 - 09.2019
Staff Software Engineer
Hortonworks
05.2017 - 09.2019
Senior SDET
Hortonworks
06.2014 - 05.2017
Software Engineer
IBM India Software Labs (ISL)
04.2010 - 06.2014
SOFTWARE ENGINEER
Aricent
02.2008 - 04.2010
Bachelor of Engineering - BE - Computer Engineering
JNTUA College of Engineering
SSC - Englishh Maths Science Social studies
SANGHAMITRA VIDYALAYAM
ST Marys English Medium High School