Avnish Kumar
Pune
Summary
Data Engineer & Backend Engineer with 7+ years of experience building scalable data pipelines, backend systems, and automation frameworks across SaaS, AdTech/Martech , Healthcare, and Travel domains. Strong expertise in Python, distributed systems, and cloud-native architectures.
Proven track record of designing high-availability, low-latency systems and building large-scale data pipelines handling millions of records. Experienced in Warehouse optimization, data quality, and distributed processing (work queue–driven systems) to improve performance, reliability, and cost efficiency.
Hands-on experience in data enrichment and standardization.
Demonstrated ability to reduce manual effort through automation, improve data reliability, and enhance system performance using scalable microservices and serverless architectures.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Tech Lead
Terminus
Remote, India
03.2024 - Current
- Designed and implemented a work queue–driven ingestion system:Broke large datasets into smaller work units using divide-and-conquer strategy
Enabled parallel processing, better fault isolation, and improved throughput for large-scale pipelines
- Built high-scale ingestion pipelines (3M+ records) with reliable execution for long-running jobs
- Developed data quality & enrichment systems:Domain resolution & validation
Address parsing, normalization, and completion
Cross-source data standardization
- Designed and implemented a canonical data model to unify heterogeneous data sourcesImproved consistency and usability across downstream systems
- Established data lineage tracking for traceability:Enabled source-to-consumption visibility
Improved debugging, auditing, and data trust
- Improved data availability, consistency, and pipeline reliability through better orchestration and failure handling
- Optimized Snowflake pipelines via query tuning, warehouse optimization, and efficient data modeling
- Reduced manual effort by 70% through automation of ingestion and scraping systems
- Led Data Engineering efforts for ABM product, aligning data pipelines with business use cases
- Proactively resolved production data issues, ensuring consistent and reliable data delivery
Software Engineer
LiftLab
Pune, India
03.2023 - 03.2024
- Built serverless ingestion framework → reduced processing time by 30%
- Implemented retry strategies and fault tolerance → reduced failures by 25%
- Automated onboarding pipelines → improved ingestion speed by 40%
- Developed scalable integrations for external data sources
Associate Software Engineer
Biddano
Pune, India
11.2021 - 01.2023
- Led end-to-end product development and feature integration, which increased user engagement by 50–60% and expanded system capabilities by 25%.
- Migrated monolith to microservices, which improved scalability, maintainability, and reduced infrastructure costs by 25%.
- Built real-time systems using WebSockets for live tracking, improved user experience by 25%, and reduced response time by 30%.
- Designed and optimised APIs, reducing latency from 500–700 ms to 10–40 ms (~10x improvement).
- Developed a high-performance search system (Manticore + Golang) with a 50x improvement in search performance.
- Built geo-spatial systems and geo-fencing APIs, improving location-based capabilities by 25%.
- Improved system performance by 25–50% through optimisation and efficient architecture design.
- Reduced production bugs and improved stability (20%+ reliability gain) through proactive debugging and quality improvements.
- Created reporting modules and aligned closely with product teams, which improved reporting satisfaction by 20%.
- Reduced onboarding time by 30% via documentation and system analysis.
- Drove adoption of new technologies, improving overall system efficiency by 20%.
Senior Software Engineer
ITILITE
Bengaluru(Remote), India
08.2021 - 11.2021
- Built an autobilling and self-subscription module for a B2B travel and expense management platform, delivering within one month.
- Designed and developed backend systems for subscription lifecycle, including billing cycles, renewals, and cancellations.
- Developed scalable microservices and APIs to support subscription workflows.
- Integrated payment gateway (Stripe) for secure and seamless transactions.
Associate Software Engineer
Tarams
Bengaluru, India
11.2019 - 08.2021
- Built an end-to-end Clinical Pharmacology System for a leading Mexican healthcare provider.
- Owned the full product lifecycle (backend and frontend development, deployment, and support) with a small team of two engineers.
- Designed and developed scalable backend services, and user-facing interfaces for mission-critical workflows.
- Ensured high system reliability and performance, improved stability, and reduced response time.
- Collaborated with business stakeholders to align product functionality with healthcare requirements.
Associate Software Engineer
AxisRooms, AR Hospitality Solutions
Bengaluru, India
12.2018 - 11.2019
- Built and optimised OTA scraping systems to extract data from multiple travel platforms, which improved data acquisition speed by 40%.
- Enhanced scraper performance by up to 60% and reduced data processing time by 20% through system-level optimisations.
- Diagnosed and resolved production issues, reduced system downtime by 25%, and improved overall reliability.
- Developed new modules and contributed to system expansion, increasing platform capabilities by 30%.
- Worked on revenue management systems, improving forecasting accuracy by 15%.
- Independently led a project end-to-end, including development, scaling infrastructure, and onboarding new developers.
- Optimised systems to handle rapid customer growth, ensuring stable performance and uninterrupted service.
Education
Bachelor of Technology - Computer Science & Engineering(CSE)
ITM UNIVERSITY
01-2018
Skills
Languages: Python, Golang, JavaScript
Frameworks and Tools: Django, Flask, DRF and FastAPI, Airflow, Pandas and NumPy
Data Engineering: ETL/ELT, Data Pipelines, Data Quality, and Data Lineage
Architecture and Systems: Microservices, Data Pipeline Architecture, Distributed Processing, Serverless Frameworks, REST
Backend and Processing: Celery, Celery Beat, and RabbitMQ
Databases: Snowflake, PostgreSQL, MySQL, and MongoDB
Cloud & Infra: AWS (S3, SES, SNS, KMS, Lambda, Batch, CloudWatch, EC2, ECS, RDS, API Gateway, EKS), Docker, Git
Search & Caching: Elasticsearch, Manticore, Redis, Memcached
GIS: GeoDjango, Postgres GIS
Frontend: JavaScript, HTML, CSS
Operating Systems: Linux, macOS
AI Tools: Claude Code
Certification
- Python Programming – Dataquest
- Python for Data Science (Fundamentals & Intermediate) – Dataquest
- Cutshort Certified Golang (Basic)
- Cutshort Certified Django (Basic)
- Claude 101
- Claude Code in Action
Timeline
Tech Lead
Terminus
03.2024 - Current
Software Engineer
LiftLab
03.2023 - 03.2024
Associate Software Engineer
Biddano
11.2021 - 01.2023
Senior Software Engineer
ITILITE
08.2021 - 11.2021
Associate Software Engineer
Tarams
11.2019 - 08.2021
Associate Software Engineer
AxisRooms, AR Hospitality Solutions
12.2018 - 11.2019
Bachelor of Technology - Computer Science & Engineering(CSE)
ITM UNIVERSITY