ANUPAM MISHRA
Hyderabad
Summary
Over 14 years of data engineering experience with a focus on data warehousing, ETL processes, and cloud migration in tech and analytics sectors. Led successful data migration projects at Modernizing Medicine, enhancing workflows and operational efficiency through innovative solutions. Developed expertise in cloud architecture and data pipeline optimization while progressing through roles at Tata Consultancy Services. Redesigned ETL workflows, achieving over 30% performance improvement and reducing processing time by more than 10 hours weekly, utilizing tools like Apache Airflow, Databricks, and AWS.
Overview
15
15
years of professional experience
Work History
Senior Data Engineer/Manager
Modernizing Medicine
Hyderabad
09.2024 - Current
- Spearheading legacy data pipeline migration to modern frameworks (Apache Airflow, Databricks), enhancing data processing and streamlining workflows.
- Collaborating with cross-functional teams to define business requirements and translate them into effective data engineering solutions aligned with organizational goals.
- Optimizing ETL processes to ensure timely, accurate data availability for analytics and reporting, improving data flow efficiency.
- Assessing and improving data workflow performance, identifying bottlenecks, and executing strategies to enhance overall system efficiency.
- Developing and maintaining documentation for data engineering processes, ensuring knowledge transfer and compliance with best practices.
- Mentoring junior engineers and fostering a culture of continuous learning, while leading strategic discussions to align data initiatives with business objectives.
Lead Data Engineer
Nielsen
Bangalore
07.2022 - 09.2024
- Aligned development, QA, and stakeholders through clear communication, ensuring timely delivery of key features.
- Accelerated development by designing and implementing reusable, high-performance code modules.
- Architected scalable and maintainable software systems to support future growth.
- Minimized system downtime through rigorous testing and debugging, ensuring seamless operations.
- Mentored junior developers, enhancing team productivity and fostering professional growth.
- Translated client data needs into actionable engineering solutions, driving business value.
- Awarded 'Best Team Leader' for exceptional leadership and mentoring.
Lead Data Engineer
EPAM Systems India Pvt. Ltd.
Pune
06.2022 - 07.2022
- Led and contributed to a data ingestion project, ensuring successful integration from diverse sources.
- Translated client data requirements into effective engineering solutions, meeting critical business needs.
- Enhanced team efficiency by developing automation scripts to streamline workflows and reduce repetitive tasks.
- Maintained high-quality standards through Jira story reviews and rigorous code reviews.
Senior Data Engineer
Tata Consultancy Services Ltd
Bhubaneshwar
04.2021 - 06.2022
- Mentored junior engineers, fostering continuous improvement and professional growth through best practice guidance.
- Collaborated with sales to translate customer needs into data engineering solutions, driving business success.
- Optimized project outcomes by maximizing resource utilization (personnel, materials, equipment).
- Ensured system reliability by developing maintenance plans and preventive measures to minimize production downtime.
Senior Data Engineer
Tata Consultancy Services Ltd
Oldsmar
07.2019 - 03.2021
- Led the cloud migration of critical ETL components as a Subject Matter Expert, ensuring a seamless transition.
- Migrated historical data from Netezza to AWS data lakes, enhancing data accessibility and analytics.
- Optimized data processing efficiency and reliability through Apache Airflow and SQL optimization.
- Built strong stakeholder relationships by delivering accurate, tailored data reports.
Onsite Technical Lead - Data Engineering Team
Tata Consultancy Services Ltd
Oldsmar
05.2015 - 06.2019
- Managed multiple projects concurrently, prioritizing tasks to consistently meet deadlines and deliver high-quality results.
- Streamlined project workflows, improving team performance and ensuring timely delivery of client-focused solutions.
- Collaborated with stakeholders to define product feature lists and ensure scalable application rollouts.
- Optimized application performance and strengthened controls through organized system operating procedures, code reviews, and debugging.
Data Engineer
Tata Consultancy Services Ltd
Chennai
09.2010 - 04.2015
- Developed comprehensive software functionality documentation for future reference and maintenance.
- Accelerated development speed by automating repetitive tasks, boosting overall productivity.
Education
Bachelor of Engineering - Electrical & Electronics Engineering
Cochin University
Kochi, KL01.2010
Skills
- Python programming
- Apache Airflow orchestration
- DBT transformations
- Data warehousing solutions
- Dimensional modeling
- Performance tuning
- AWS cloud services
- Delta Lake integration
- Unity Catalog management
- Databricks workflows
- Spark processing
- Netezza database management
- SQL querying
- RDS administration
- CI/CD pipelines
- Data governance strategies
- ETL optimization
- Cloud migration frameworks
- Agile project management
- Data quality assurance
- Business intelligence solutions
- Advanced analytics implementation
- System architecture design
Personal Information
Date of Birth: 08/25/88
Languages
- English
- Hindi
Timeline
Senior Data Engineer/Manager
Modernizing Medicine
09.2024 - Current
Lead Data Engineer
Nielsen
07.2022 - 09.2024
Lead Data Engineer
EPAM Systems India Pvt. Ltd.
06.2022 - 07.2022
Senior Data Engineer
Tata Consultancy Services Ltd
04.2021 - 06.2022
Senior Data Engineer
Tata Consultancy Services Ltd
07.2019 - 03.2021
Onsite Technical Lead - Data Engineering Team
Tata Consultancy Services Ltd
05.2015 - 06.2019
Data Engineer
Tata Consultancy Services Ltd
09.2010 - 04.2015
Bachelor of Engineering - Electrical & Electronics Engineering
Cochin University