Open To Work
MALLIKA NAYAK
BENGALURU
Summary
Staff-level Software Engineer with 11+ years of experience designing and scaling distributed systems across global finance, retail, and SaaS platforms. Proven track record at Microsoft and Walmart Labs in architecting fault-tolerant services (500+ TPS, 99.99% uptime) and optimizing ML pipelines for search relevance. Expert in industrializing AI through LLM gateways, evaluation pipelines, and vector search systems
Overview
11
11
years of professional experience
Work History
AI Infrastructure Engineer
Independent Research & Development
Bangalore
01.2025 - Current
- Enterprise LLM Gateway: Architected a production-grade gateway using FastAPI to manage LLM lifecycles, featuring Semantic Caching via RedisVL to reduce redundant API costs by 30%.
- Shadow Deployment Engine: Engineered a non-blocking traffic mirroring system to validate new prompt versions against live production data using asynchronous workers to ensure zero latency impact.
- Automated Evaluation Pipeline: Developed an "LLM-as-a-Judge" scoring engine using GPT-4o/Claude 3.5 to evaluate shadow model outputs on brand safety and relevancy before production promotion.
- LLM Search API: Developed integrated search API with LangChain and Vector Databases for semantic retrieval and RAG-based workflows.
Software Development Engineer II (SSE-level scope)
Microsoft
Bengaluru
01.2020 - 12.2024
- Unified Routing System: Designed and optimized a large-scale distributed system for Microsoft Dynamics, handling thousands of concurrent work items per minute with 99.99% uptime.
- Microservices Optimization: Developed and optimized Contact Center microservices integrating Azure Functions, EventGrid, and Redis, improving request processing efficiency.
- Custom Assignment Feature: Led the implementation of "Custom Assignment," a long-deferred enterprise feature for configurable routing logic, through to GA release.
- Infrastructure Excellence: Containerized local development environments with Docker, reducing the test feedback loop and onboarding time by 50%.
- Technical Leadership: Mentored 4 engineers and contributed to cross-team design and observability initiatives.
Software Engineer 3 - Search Relevance Team
Walmart Labs
Bengaluru
06.2018 - 11.2019
- Technologies: Java, Python, Apache Airflow, Jenkins, Hive, Apache Spark, Lucene, Kafka
- Built and scaled ML pipelines and experimentation frameworks to power search relevance, ranking, and personalisation for Walmart's e-commerce platform.
- Developed and optimized search ranking algorithms to improve query relevance, ranking quality, and product discoverability.
- Worked with data scientists, product managers, and UX teams to tune features, evaluate A/B tests, and improve ranking models(XGBoost, LambdaMART)
- Created a trend prediction engine using time-series modeling (Hackathon winner); deployed in production for Grocery search boost.
- Walmart's e-commerce platform.
Senior Technology Associate
Morgan Stanley
Bengaluru
10.2015 - 06.2018
- Technologies: Java, Spring, Kafka,SQL, REST APIs
- Developed scalable, auditable backend platforms for KYC, tax compliance, and client reference data, critical to the firm's global regulatory adherence.
- Refactored legacy monolithic tax systems into event-driven services, reducing processing from 24h to ~30m.
- Led technical initiatives involving secure document workflows, RESTful service design, and integration with compliance/legal business units.
Technology Analyst
HSBC
Bengaluru
10.2014 - 10.2015
- Worked as a Technology Analyst in Consumer Loans and Mortgage teams.
- Implemented CML websites for loan specialists which acts as one-stop place to get all the existing loans, accounts and follow-ups with the account holders.
Education
M.Tech -
International Institute of Information Technology
Bangalore07-2014
B.E - Information Science
BVB College of Engineering And Technology
06-2012
Skills
- AI/ML Infra: LLM Orchestration (LangChain), Vector DBs, Prompt Engineering, Search Ranking, A/B Testing
- Languages & Frameworks: Python, Java, C#, TypeScript, Spring Boot, FastAPI, NET Core
- Cloud & Infra: Azure (AKS, Functions, CosmosDB), AWS (EC2, S3), Docker, Kubernetes, Kafka, Redis
Accomplishments
- Optimized Development Speed at Microsoft: Decreased development cycle time by 50% with Docker integration, eliminating the need for shared internal dev environments
- Won Walmart's Internal hackathon: Developed a predictive model for grocery purchase trends, later integrated as a key signal to enhance search functionality.
- Accelerated Tax Processing - Morgan Stanley: Reduced tax workflow processing time from 24 hrs hours to 30 minutes.
Work Preference
Job Search Status
Open to workSalary Range
₹45000/yr - ₹200000/yrTimeline
AI Infrastructure Engineer
Independent Research & Development
01.2025 - Current
Software Development Engineer II (SSE-level scope)
Microsoft
01.2020 - 12.2024
Software Engineer 3 - Search Relevance Team
Walmart Labs
06.2018 - 11.2019
Senior Technology Associate
Morgan Stanley
10.2015 - 06.2018
Technology Analyst
HSBC
10.2014 - 10.2015
M.Tech -
International Institute of Information Technology
B.E - Information Science
BVB College of Engineering And Technology