Manish Roy
Bangalore
Summary
- Lead Data Engineer with 14+ years of experience across retail, oil & gas, energy & banking domains.
- 8+ years building and operating large-scale Big Data platforms on 400+ node Hadoop clusters & Cloud migration.
- Leading end-to-end data platform migration to the cloud, driving cloud modernization and automation-first initiatives at Lowe’s Services India Pvt. Ltd.
- Google Cloud Professional Cloud Architect (Certified) with expertise in distributed systems.
- Experienced in managing high-severity outages, performance bottlenecks, and root cause analysis.
- Hands-on experience enabling MCP and RAG-based applications for modern data platforms.
Overview
15
15
years of professional experience
Work History
Lead Data Engineer
Lowe’s Services India Pvt. Ltd.
06.2021 - Current
- Leading the end-to-end migration of the enterprise data platform from on-prem CDP to Google Cloud Platform (GCP), establishing a cloud-native, scalable, and resilient analytics foundation.
- Designed and delivered a standardized analytics platform for application teams using BigQuery and Dataproc Serverless, improving performance, cost governance, workload isolation, and multi-tenant scalability while eliminating long-lived Spark clusters.
- Designed and built an LLM-powered BigQuery optimization engine providing automated recommendations to improve query performance and cost efficiency.
- Designed and implemented a BigQuery MCP server to centralize access to table-level metadata, usage insights, and optimization signals, enabling RAG-based intelligent platform use cases.
- Built centralized monitoring and alerting dashboards using Grafana, delivering real-time visibility into platform health, performance, and usage trends.
- Implemented proactive alerting (threshold-based and anomaly-driven), significantly reducing issue detection time and lowering MTTR.
- Enabled capacity planning and performance tuning through historical metrics analysis, trend reporting, and usage dashboards.
- Developed GCP cost monitoring dashboards to detect service-level cost anomalies and spend spikes, enabling proactive investigation and cost governance.
- Owned platform reliability and operations, including incident management, root cause analysis, and coordination with ITSM teams.
- Leading a team of 6 engineers supporting Hadoop and cloud platforms, ensuring operational excellence and platform stability.
- Led cross-functional teams to optimize data architecture and improve system performance.
Big Data Platform Engineer
ExxonMobil Services & technology Pvt. Ltd.
04.2020 - 05.2021
- Operated and supported large-scale Hadoop platforms, ensuring high availability, performance, and reliability.
- Performed capacity planning, performance tuning, and benchmarking to improve cluster stability and workload efficiency.
- Conducted deep JVM, GC, and HPROF analysis to diagnose and resolve critical service failures.
- Implemented and maintained security and multi-tenancy controls including Kerberos, Ranger, Knox, HDFS encryption, and AD/LDAP integration.
- Supported platform upgrades, patching, and operational best practices across the Hadoop ecosystem.
Sr. System Engineer
Siemens Technology and Services
06.2017 - 03.2020
- Supported and optimized enterprise Big Data platforms built on HDFS, Hive, Spark, and YARN.
- Improved platform performance and reliability through resource tuning, monitoring, and operational automation.
- Delivered Linux system administration and troubleshooting across CPU, memory, storage, and network layers.
Specialist
HCL Technology Pvt. Ltd.
02.2015 - 05.2017
- Provided production and operational support for Hadoop and distributed data platforms for Deutsche Bank, including provisioning, managing, and optimizing Big Data clusters, and handling incidents and performance issues.
- Recognized multiple times for operational excellence and customer impact while supporting mission-critical banking workloads.
Customer Support Engineer
IND Innovation Pvt. Ltd.
03.2013 - 01.2015
- Worked as a Data Center Engineer, providing OEM-level support for Ericsson, Airtel, and HCL, supporting HP, Dell, and IBM servers and storage systems, including installation, troubleshooting, and break-fix operations.
Smart Class Coordinator
Educomp Solution Ltd.
07.2010 - 04.2012
- Managed and supported classroom technology deployments and IT operations.
- Coordinated with stakeholders to ensure smooth delivery of digital learning solutions.
Education
Bachelor of Science - Computer Applications Development
Amrapali Institute of Science & Technology
Haldwani01.2010
Skills
- Cloud: Google Cloud Platform (GCP), BigQuery, Dataproc Serverless
- Big Data & Data Engineering: Spark 3, Hadoop (HDFS, YARN), Hive, Trino, SQL
- Platform Architecture: Cloud migration, multi-tenant data platforms, workload isolation, capacity planning
- Cost & Performance: BigQuery cost optimization, performance tuning, usage analytics
- Observability & Operations: Grafana, monitoring, alerting, incident management, RCA
- Security: Kerberos, Ranger, Knox, HDFS encryption, AD/LDAP
- AI & Intelligence: LLM-powered optimization, RAG-based applications, MCP servers
- Automation & Orchestration: Airflow, CI/CD pipelines
- Systems: Linux (RHEL/CentOS), JVM & GC analysis
- Programming:Bash & Python
Accomplishments
- Awarded Best Employee of the Quarter twice at Lowe’s Services India Pvt. Ltd.
- Recognized twice as Best Employee of the Quarter and three times as Best Employee of the Month at HCL Technologies.
Timeline
Lead Data Engineer
Lowe’s Services India Pvt. Ltd.
06.2021 - Current
Big Data Platform Engineer
ExxonMobil Services & technology Pvt. Ltd.
04.2020 - 05.2021
Sr. System Engineer
Siemens Technology and Services
06.2017 - 03.2020
Specialist
HCL Technology Pvt. Ltd.
02.2015 - 05.2017
Customer Support Engineer
IND Innovation Pvt. Ltd.
03.2013 - 01.2015
Smart Class Coordinator
Educomp Solution Ltd.
07.2010 - 04.2012
Bachelor of Science - Computer Applications Development
Amrapali Institute of Science & Technology