MANI MANTHIRAM
Manager / Data Lead / Data Architect
Chennai,TN
Summary
Results-driven Big Data Engineer with over 10 years of experience in data analysis, cloud computing solutions, and large-scale data processing. Expertise in transforming complex datasets into actionable insights while continuously enhancing technical skills and business domain knowledge. Proficient in both cloud and on-premise platforms, leveraging cutting-edge technologies to drive data-driven decision-making. Committed to delivering innovative solutions that empower organizations to harness the full potential of their data.
Overview
10
10
years of professional experience
2
2
Certifications
Work History
Manager - Technology & Transformation
Deloitte
06.2024 - Current
- Managing a team of data engineers who are responsible for developing cloud data solutions.
- Designed and implemented scalable data architecture solutions, enhancing system performance and data retrieval efficiency for enterprise applications.
- Conducted extensive data quality assessments, identifying discrepancies and implementing corrective measures to enhance data integrity.
- Engaged with stakeholders to define data requirements, translating business needs into technical specifications for effective data solutions.
- Designed internal process improvements to automate repetitive tasks, shortening data delivery times.
Senior Data Engineer
Deloitte
01.2021 - 05.2024
- Responsible for designing scalable data models by understanding the datasets, their relationships, and business requirements.
- Responsible for ingesting the data into Databricks Delta tables by writing all the business logic through Databricks notebooks.
- Developed reusable data pipelines and scheduled them using triggers, as per the business requirements, using Data Factory.
- Designed and implemented scalable data pipelines using AWS services, enhancing data accessibility for analytics teams.
- Developed automated ETL processes using Python and SQL, resulting in a 30% reduction in data processing time.
Big Data Engineer
Cognizant
03.2016 - 01.2021
- Developed a Spark-based processing framework to process both batch and stream data using Scala.
- Part of multiple data projects and handled various types of sources, such as text files, copybooks, JSON, and delimited files.
- Worked with NoSQL databases (HBase), graph databases, Elastic Search (SOLR DB), and Gremlin queries.
- Developed multiple automation frameworks to reduce manual work and improve data quality.
Education
BE - Computer Science
Kings Engineering College - Anna University
Chennai03.2015
Skills
Apache Spark
Certification
MS Certified Data Engineer DP-203
This certification, offered by the Microsoft, focuses on mastering data engineering skills and technologies.
SKILLS
- Core Development
- Data Modelling
- Code Optimization
- Performance Tuning
- Cost Optimization
- Solution Designing
- Peer Reviews & Mentoring
- Delivery & Deployment
Accomplishments
- Developed a dynamic query execution framework to merge the datasets having no standard keys by matching the non key attributes. This provided an option to see the insights from both datasets in the same report
- Optimized Databricks notebooks and ADF pipelines, reducing end-to-end processing time by 30–60% through efficient partitioning, broadcast joins, caching strategy, and adaptive query execution
- Improved Delta Lake read performance by implementing Z-Order clustering, optimizing file sizes - leading to faster query execution and smoother downstream analytics
Timeline
Manager - Technology & Transformation
Deloitte
06.2024 - Current
Senior Data Engineer
Deloitte
01.2021 - 05.2024
Big Data Engineer
Cognizant
03.2016 - 01.2021
BE - Computer Science
Kings Engineering College - Anna University