Mayank Manral
Moradabad
Summary
Data Engineer with 6 years of experience designing, building, and optimizing scalable data pipelines, real-time streaming systems, and analytics platforms. Strong background in SQL, Kafka, Redis, Docker, Kubernetes, and cloud-native architectures. Proven ability to work across data ingestion, transformation, storage, and API layers to support analytics, reporting, and AI-driven systems. Adept at collaborating with product, analytics, and backend teams to deliver reliable, high-performance data solutions.
Overview
7
7
years of professional experience
Work History
Senior Data Engineer
Whilter Technologies Pvt. Ltd.
Gurgaon
09.2021 - Current
- Designed and implemented real-time data ingestion pipelines using Kafka, supporting high-throughput event processing for analytics and monitoring systems.
- Built data services and APIs to expose processed data for dashboards, reporting tools, and AI/ML consumers.
- Optimized SQL queries and data models, improving query performance and reducing latency in analytics workloads.
- Implemented Redis-based caching and state management to support low-latency data access.
- Managed cloud object storage (AWS S3) for large-scale audio, log, and event data, including secure access via pre-signed URLs.
- Containerized data services using Docker and deployed them on Kubernetes, ensuring scalability and fault tolerance.
- Worked closely with backend, analytics, and product teams to define data contracts, schemas, and retention strategies.
- Improved system reliability through proactive monitoring, debugging, and performance tuning of data pipelines.
Data Engineer / Backend Engineer
Motifworks
Bangalore
06.2019 - 08.2021
- Developed batch and near–real-time data processing components for transactional and analytical use cases.
- Built reusable data ingestion and transformation modules, reducing development effort across multiple projects.
- Integrated multiple data sources and APIs into centralized data stores for reporting and downstream processing.
- Improved data consistency and quality by implementing validation, error handling, and retry mechanisms.
- Collaborated with cross-functional teams to support evolving data requirements and system enhancements.
- Contributed to containerized deployments and CI/CD workflows for data-enabled backend services.
Education
Master of Computer Applications (MCA) - Information Technology
G. B. Pant University of Agriculture & Technology
Pantnagar09-2018
Skills
Data Engineering: Data Pipelines, ETL / ELT, Batch & Real-Time Processing
Streaming & Messaging: Apache Kafka, Event-Driven Architectures
Distributed Processing: Apache Spark, PySpark
Data Warehousing: Amazon Redshift, BigQuery, Snowflake
Orchestration: Apache Airflow, Dagster
Data Lake / Lakehouse: S3-based Data Lakes, Lakehouse Architecture Concepts
Databases: MySQL, MongoDB, Redis
Programming: Java, Python (Data Processing & Automation)
APIs & Integration: REST APIs, Data Services
Containerization & DevOps: Docker, Kubernetes
Cloud & Storage: AWS (S3), Object Storage, IAM
Version Control: Git
Performance & Reliability: Query Optimization, Monitoring, Debugging
Timeline
Senior Data Engineer
Whilter Technologies Pvt. Ltd.
09.2021 - Current
Data Engineer / Backend Engineer
Motifworks
06.2019 - 08.2021
Master of Computer Applications (MCA) - Information Technology
G. B. Pant University of Agriculture & Technology