PARVATHI MADHU NAIR
Mumbai
Summary
Dynamic Confluent Kafka Developer at Tata Consultancy Services, adept at automating Kafka infrastructure and enhancing observability. Expert in Python scripting and cross-team collaboration, I successfully integrated cloud metrics into ELK dashboards, thus improving real-time visibility. Proven ability to manage event-driven architectures, ensuring stable delivery across distributed systems.
Overview
1
1
Certification
5
5
years of professional experience
Work History
Confluent Kafka Developer
TATA CONSULTANCY SERVICES
Mumbai
08.2023 - Current
- Automated end-to-end Kafka self-service on Confluent Cloud using Python, Terraform, and CI/CD pipelines, streamlining request handling from ServiceNow (SNOW) through Apigee to Azure DevOps, with a watcher pipeline providing real-time success or failure updates to SNOW, significantly reducing manual provisioning time.
- Automated topic creation, and publish and subscribe access provisioning, helping reduce manual setup time and ensuring consistent, auditable topic configuration.
- Automated topic deletion, including removal of the topic record from the SNOW database table, helped reduce manual cleanup effort and keep topic records accurate.
- Automated consumer offset resets through pipeline-driven requests, helping reduce turnaround time for consumer recovery and replay scenarios.
- Automated topic owner additions and topic configuration changes such as partition count adjustments and retention increases, helping eliminate manual back-and-forth and speed up request fulfillment.
- Facilitated automation and observability of production-grade Kafka infrastructure for L'Oréal Beauty Tech client across global and China Ali Cloud environments, coordinating development and cross-team collaboration to enhance operational efficiency.
- Worked within an event-driven architecture ecosystem using Kafka as an event backbone for asynchronous, loosely coupled microservice communication; helped manage event schemas, topic lifecycles, and consumer groups for stable event delivery across distributed systems.
- Built Confluent Flink audit listener to filter and process audit topic events, then integrated the solution into production pipeline.
- Developed Python topic-owner automation script with a DevOps pipeline to update ownership across Confluent Cloud UI and backend JSON.
- Built partition analysis framework to classify topics across regions as over-, under-, or normally utilized, integrating insights into L'Oréal ELK dashboard for improved visibility and resource optimization.
- Designed BigQuery table structure for event-owner reporting and product analytics.
- Integrated cloud metrics into ELK stack for real-time visibility into partition counts, client connections, and retained data.
- Supported Confluent Cloud rollout on China Ali Cloud through direct coordination with the China Ali team and deployment alignment.
- Developed ELK metrics dashboard for China Ali Cloud, ensuring alignment with global monitoring standards.
- Automated retirement of inactive users accessing the Confluent Cloud UI, helping tighten access control and reduce time spent on manual user audits.
- Fixed ServiceNow Special Requests bugs (data purge) and an Access Management issue in the Confluent Flink compute pool, helping keep self-service workflows reliable.
- Transitioning Apigee authentication from OAuth to service accounts, and troubleshooting 503/502 errors on the Confluent API publish endpoint to improve project stability.
- Integrating SOC China logs to strengthen security monitoring across the China Ali Cloud environment.
- Analyzing Kafka REST API performance test results to define next steps, and planning cleanup of unused and idle topics and Azure AKS RBAC enforcement to help reduce cost and improve security.
Web Development Intern
GOPOLITIX TECHNOLOGIES
05.2021 - 12.2022
- Built responsive pages for Gopolitix Technologies' web products
- Updated HTML, CSS, and JavaScript components for client-facing interfaces
- Tested browser compatibility across desktop and mobile views
- A US-based start-up developing an app that connects political governance and local communities.
- US-based (Remote)
Web Developer (Volunteer)
UPAY NGO
03.2022 - 05.2022
- Created WordPress websites using themes and plugins to enhance user engagement.
- Developed user-friendly website layouts with HTML and CSS to improve navigation and accessibility.
Web Development Intern
THE SPARKS FOUNDATION
07.2021 - 08.2021
- Developed web-based projects that provided practical hands-on technology experience.
Web Development Intern
SAHU TECHNOLOGIES
07.2021 - 08.2021
- Assisted in client web development and technology solution projects to enhance user experience.
Education
BACHELOR OF TECHNOLOGY - INFORMATION TECHNOLOGY
Pillai College of Engineering
New Panvel05-2023
Skills
- Kafka & Streaming: Confluent Kafka, Confluent Flink, Kafka Ops
- Event streaming
- Cloud: Confluent Cloud, AWS, Continuous integration, China Ali Cloud
- DevOps & Infra: CI/CD Pipelines, Terraform, Shell Scripting, Linux, Cloud Security
- Observability: ELK Stack, Prometheus, Grafana, Splunk
- Programming: Python, C, Data Warehousing, Data TrContainer Orchestrationformation, CSS
- Frameworks & Libs: Flask, Django, Stream Processing, Pandas, NumPy, OpenCV, Mediapipe, TensorFlow/Keras
- API integration
- Microservices architecture
- Data pipeline
- Event-driven architecture
- Databases: BigQuery, Firebase
- Tools: Git, GitHub, ServiceNow, Data visualization, Data modeling
- Kafka automation
- Performance optimization
- Confluent Cloud
- Terraform management
- Unit testing
- Test-driven development
- Agile practices
- Problem-solving
- Code optimization
- Python scripting
- ELK dashboards
- Confluent Cloud
- Terraform management
- API management
Certification
Confluent Certified Developer for Apache Kafka, Microsoft Certified: Azure Fundamentals (AZ-900), Data Science in Python, The Linux Command Line PowerUser Bootcamp, Object-Oriented Data Structures in C++, PHP and MySQL – Spoken Tutorial, IIT Bombay
LANGUAGES
English, Hindi, Malayalam, Marathi
PROJECTS
- Inattentive Driver Detection & Monitoring System, Aug 2022 – Jan 2023, ResNet-50, TensorFlow/Keras, OpenCV, Dlib, Published research paper; real-time drowsiness and distraction detection using EAR & MAR analysis with automated alert mechanism.
- WELLBEINE – AI Gym Tracker & Diet Recommender, Feb 2022 – Jul 2022, Mediapipe, Django, Kaggle | Group Leader, Real-time exercise tracking with AI-driven diet recommendations.
- QUENCHX – E-Commerce Beverages Platform, Aug 2021 – Jan 2022, React.js, Firebase | Group Leader, Full-stack beverage e-commerce platform with user authentication and product management., Clinic Management System, Aug 2020 – Jan 2021, Python Flask, SQLite3, SQLAlchemy, Web application for managing doctor appointments, treatments and patient records., Library Management System, Feb 2020 – Jul 2020, Java, PhpMyAdmin, Java-based application for managing digital book rentals and library operations.
PERSONAL INFORMATION
Title: Confluent Kafka Developer | System Engineer
Timeline
Confluent Kafka Developer
TATA CONSULTANCY SERVICES
08.2023 - Current
Web Developer (Volunteer)
UPAY NGO
03.2022 - 05.2022
Web Development Intern
THE SPARKS FOUNDATION
07.2021 - 08.2021
Web Development Intern
SAHU TECHNOLOGIES
07.2021 - 08.2021
Web Development Intern
GOPOLITIX TECHNOLOGIES
05.2021 - 12.2022
BACHELOR OF TECHNOLOGY - INFORMATION TECHNOLOGY
Pillai College of Engineering