Jeyaradhi Shanmugasundaram
Chennai
Summary
Results driven Data Engineer with over 6+ years of relevant experience in designing and implementing transformative data solutions that drive significant organizational improvements. Proficient in leveraging cloud technologies such as Azure and AWS to streamline data management and analytics workflows. A strong advocate for collaboration within agile teams, facilitating impactful, data-driven decision-making and innovative solutions. Dedicated to continuous improvement and the application of advanced analytics to support strategic business objectives.
Overview
15
15
years of professional experience
Work History
Technical Lead, Data & AI Practice
Bahwan Cybertek
Chennai
11.2024 - Current
- Built a metadata-driven Universal Ingestion Framework supporting multi-source ingestion (flat files, REST APIs etc ) to target systems (Cloud/Postgres) with incremental watermark tracking, dynamic schema handling, and a centralised control layer for pipeline orchestration.
- Architected a real-time insurance data ingestion pipeline on Databricks SDP, streaming multi-source insurance data using medallion architecture into a unified data layer powering RAG-based AI query interfaces for intelligent, natural language access to insurance domain knowledge.
- Led the migration of ~40 complex Teradata stored procedures to Databricks SQL, ensuring 100% functional parity with legacy business logic.
- Migrated ETL workflows from Teradata to Databricks, leveraging Azure DevOps CI/CD pipelines and Databricks Asset Bundles for modular, version-controlled deployment of notebooks, jobs, and configurations.
- Designed and developed Databricks stored procedures handling large-scale datasets (millions of records) with consistent data accuracy and performance.
- Refactored Teradata-specific constructs (volatile tables, QUALIFY, UPDATE FROM) into Databricks-compatible patterns.
- Performed comprehensive QA testing, including row-count reconciliation, data validation, and edge-case testing to ensure migration correctness.
- Collaborated with cross-functional teams to validate business logic, data consistency, and production readiness.
- Developed data ingestion pipelines from various data sources like SAP, Snowflake, AWS S3, and flat files.
- Optimized data transformations and complex queries for performance within Databricks, focusing on the gold layer for analytics.
- Worked on development of Business Intelligence dashboards primarily in Supply chain management and Finance for Pharmaceutical industry.
Advisory Analytics Developer
Kinaxis
Chennai
10.2021 - 11.2024
- Designed, developed, and deployed a foundational data model in Azure to serve as a single source of truth for reporting resulting in increased confidence in data across the org and 30% decrease in reporting time for the analytics team.
- Developed and executed use cases and ETL procedures using API ingestion and File based Ingestion using Python and SQL in Azure Data-bricks ensuring seamless data processing and analysis resulting in 30% reduction in data processing time.
- Implemented data governance solution using Azure Unity Catalog, enabling tagging as additional metadata for catalog/database/table in a multi-tenant workspace.
- Collaborated with Data Management team to design, develop, and implement optimal data schemes, models, storage, and analytic solutions supporting organizational goals.
- Led migration of Apache Hop from legacy ETL platform, conducting data validation assessments to identify gaps and align with organizational AI solution.
- Developed Data-bricks Lake view dashboards for data profiling and semantic summary which reduced the manual effort by 50%.
- Worked on multiple POCs, understanding data and mapping it to the data model.
- Championed a team of 5, overseeing reporting analysts, providing mentorship and guidance to optimize team performance and drive successful implementation of the solution.
Senior Data Analyst
Infosys
Chennai
08.2020 - 10.2021
- Modelling the data using Machine Learning techniques using AWS Forecasting(6 ML models) to predict the demand of AC units and improving the accuracy by 20%.
- Automated forecasting process using AWS (S3, Sagemaker, Gluejobs), delivering precise and timely predictions of future demand.
- Provided accurate forecasts and predictions for upcoming AC orders, enabling strategic leverage in production planning and management through ML solutions.
- Evaluated and refined data quality by removing discrepancies and conducting various hypothesis tests to ensure reliability.
- Engineered Azure Data Factory pipelines for streamlined data ingestion, handling one-time and incremental loads with multiple SCD types.
Associate
Cognizant
Chennai
05.2018 - 05.2020
- Implemented cash forecasting functionality in PeopleSoft, enhancing financial planning processes.
- Developed statistical models to forecast unconstrained demand quantity for F&V, providing SKU-level forecasts for priority products using ABC-XYZ methodology.
Application Developer
DXC Technology
Chennai
10.2013 - 05.2018
- Resolved critical production issues in Billing module, ensuring timely support for O2C month-end closure activities.
Software Engineer
Verizon Data Services
Chennai
06.2011 - 10.2013
- Contributed as a core team member for production support in AP, EX, and billing modules.
Education
PG Diploma - Business Analytics
XLRI
Jamshedpur04-2020
Bachelor of Engineering -
Anna University
Chennai05-2011
Skills
- SQL, PySpark, Python
- PySpark
- Data modeling and warehousing
- Business intelligence
- Data management and governance
- Machine learning
- Azure Databricks and DevOps CI/CD
- ETL processes
- Agile and Scrum methodologies
- Snowflake
- Cross-functional collaboration
Timeline
Technical Lead, Data & AI Practice
Bahwan Cybertek
11.2024 - Current
Advisory Analytics Developer
Kinaxis
10.2021 - 11.2024
Senior Data Analyst
Infosys
08.2020 - 10.2021
Associate
Cognizant
05.2018 - 05.2020
Application Developer
DXC Technology
10.2013 - 05.2018
Software Engineer
Verizon Data Services
06.2011 - 10.2013
PG Diploma - Business Analytics
XLRI
Bachelor of Engineering -
Anna University