REVANTHA KUMAR M
Bengaluru
Summary
Accomplished Data Engineer with a proven track record at INFOSYS, specializing in designing high-performance ETL pipelines and optimizing data workflows. Proficient in Python and SQL, I enhanced data processing efficiency and ensured data integrity, while demonstrating strong problem-solving skills and effective communication in cross-functional teams.
Overview
4
4
years of professional experience
1
1
Certification
Work History
Data Engineer
INFOSYS
01.2024 - Current
- Designed and maintained end-to-end batch ETL pipelines using Apache Airflow for high-volume financial datasets.
- Orchestrated data ingestion from Microsoft SQL Server, performed transformations using Python and Pandas, and delivered analytics-ready data to Amazon Redshift via AWS S3.
- Developed custom Airflow operators, implemented dependency management, retry logic, and SLA monitoring for faulttolerant workflows.
- Implemented data quality checks using batch metadata validation and record-level reconciliation to ensure accuracy and consistency.
- Improved transformation performance through chunk-based processing, optimized data types, and vectorized Pandas operations, significantly reducing execution time.
- Automated Redshift data loads using dynamically generated COPY commands, IAM role-based security, and pre-load table cleanup.
- Standardized multi-environment configurations (dev/prod) using Airflow Variables and connections.
- Led and executed Airflow migration from version 1.x to 2.x, improving scalability, observability, and system stability with zero production downtime.
- Integrated real-time monitoring and alerts using Slack, email, and webhooks to reduce failure response time.
- Proactively monitored DAG performance and logs, resolving issues to maintain high pipeline uptime.
Data Engineer
Market Data Systems
01.2022 - 01.2024
- Developed and maintained backend services using ASP.NET MVC and WCF to deliver real-time financial and market data.
- Built high-performance REST APIs aggregating data from SQL Server, Elasticsearch, and third-party financial data providers.
- Designed efficient database interaction layers using stored procedures and Table-Valued Parameters (TVPs) for complex analytical queries.
- Implemented Redis caching strategies with optimized TTLs, reducing API response time by over 60% and lowering backend load.
- Ensured data integrity by mapping and normalizing financial datasets into strongly typed C# models with robust error handling and serialization.
Education
M. Tech - Mechanical Engineering
Madanapalle Institute of Technology & Science (MITS)
01.2019
Skills
- Python and SQL
- Data orchestration and scheduling
- ETL pipelines and data ingestion
- Data transformation and validation
- Batch processing and performance optimization
- AWS S3 and Amazon Redshift
- Apache Airflow and UI
- Logging and Slack alerts
- Git and GitHub
Certification
- Microsoft Azure Fundamentals
- Client Appreciation Award for on-time and high-quality delivery
- 2× Infosys Insta Awards for exceptional performance and impact
Timeline
Data Engineer
INFOSYS
01.2024 - Current
Data Engineer
Market Data Systems
01.2022 - 01.2024
M. Tech - Mechanical Engineering
Madanapalle Institute of Technology & Science (MITS)