Mani Manthiram
Chennai
Summary
Senior Data Engineer with 10 years of experience in designing and optimising large-scale batch data platforms using Databricks, Apache Spark, and Delta Lake. Expertise in distributed batch processing and developing reliable data pipelines ensures data availability and analytical readiness. Committed to delivering scalable data solutions that support organisational growth through disciplined engineering practices and technical leadership.
Overview
1
1
Certification
11
11
years of professional experience
Work History
Azure Architect
Fractal Analytics
Chennai, India
03.2026 - Current
- Developed ontology-driven, AI-ready semantic layer on Snowflake platform using Cortex Analyst to enhance data accessibility.
- Constructed end-to-end pipeline to generate ontology and establish predicates and relationships for semantic model on Snowflake.
- Created and validated semantic view, ensuring accuracy and optimisation of model performance.
- Achieved Claude Certified Architect - Foundations certification
Manager - Technology & Transformation
Deloitte
Chennai
06.2024 - 03.2026
- Implemented Delta Lake to ensure ACID transactions, data reliability, versioning, and efficient batch processing across large datasets.
- Designed and implemented scalable data architectures to support enterprise applications, improving system performance, and data retrieval efficiency.
- Defined and maintained analytical data models (Star Schema) by analysing business requirements and dataset relationships to enable accurate reporting and analytics.
- Collaborated with business and technical stakeholders to translate data requirements into clear technical specifications and scalable data solutions.
- Led and managed a team of data engineers, driving process automation and the delivery of cloud-based data solutions to reduce turnaround times.
Senior Data Engineer
Deloitte
Chennai
01.2021 - 05.2024
- Implemented data ingestion and transformation logic into Databricks Delta tables using Databricks notebooks, embedding end-to-end business rules, and validations.
- Built reusable, parameterized data pipelines and orchestrated them using Azure Data Factory triggers aligned with business schedules and dependencies.
- Delivered scalable Azure-based data pipelines, improving data accessibility and usability for analytics, and BI teams.
- Automated validation workflows using PySpark and SQL, achieving a 30% reduction in data processing time through performance optimisation.
- Provided mentorship and guidance to junior data engineers.
Big Data Engineer
Cognizant
Chennai
03.2016 - 01.2021
- Designed and built a Spark-based batch and streaming processing framework using Scala, enabling scalable and fault-tolerant data pipelines.
- Delivered multiple data engineering projects, integrating diverse data sources including text, copybooks, JSON, and delimited formats.
- Worked with NoSQL, search, and graph technologies such as HBase, Elasticsearch (Solr), and graph databases, leveraging Gremlin queries for complex data traversal.
- Created automation and data quality frameworks. Cut manual effort, boosting data accuracy, consistency, and pipeline reliability.
- A global leader in IT services, consulting & business solutions
Education
Bachelors in Engineering - Computer Science
Anna University
Chennai, TN05-2015
Skills
- Azure Cloud
- Azure Databricks
- Claude Code
- Delta Lake
- Apache Spark
- PySpark
- SQL
- Azure Data Factory
- Batch processing
- Medallion Architecture
- Data Modelling (Star Schema)
- Performance Optimisation
- ETL
- Hadoop
- HDFS
- Scala
- Python
- NoSQL
- Apache HBase
- Solr
- Titan Graph
- Unity Catalog
- Data Architecture
- Solution Design
- Azure DevOps
- GitHub
- CI/CD Pipelines
- Agile
- Scrum
- JIRA
- Requirements analysis
- Team Management
- Mentorship
- Code & Design Reviews
- Cost efficiency
- Stakeholder relations
Certification
- Claude Certified Architect - Foundations from Anthropic
- MS Certified Data Engineer
- SQL Advanced, HackerRank
- Neo4j Professional Certification, Certification shows the knowledge of Graph Databases
- Partner Training - Developer Essential, Databricks
Accomplishments
- Databricks Optimisation, Optimized Databricks notebooks and ADF pipelines, reducing end-to-end processing time by 30-60% through efficient partitioning, broadcast joins, caching strategy, and adaptive query execution
- Dynamic Data Merging Framework, Developed a dynamic query execution framework to merge the datasets having no standard keys by matching the non-key attributes. This provided an option to see the insights from both datasets in the same report
- Delta Lake Performance Improvement, Improved Delta Lake read performance by implementing Z-Order clustering, optimizing file sizes - leading to faster query execution and smoother downstream analytics
Timeline
Azure Architect
Fractal Analytics
03.2026 - Current
Manager - Technology & Transformation
Deloitte
06.2024 - 03.2026
Senior Data Engineer
Deloitte
01.2021 - 05.2024
Big Data Engineer
Cognizant
03.2016 - 01.2021
Bachelors in Engineering - Computer Science
Anna University