ELAN THAMIZHAN
Data Engineer
Chennai
Summary
Experienced Data Engineer with 9.5 years of expertise in designing and developing robust, scalable, and efficient data pipelines and solutions. Proficient in managing large-scale data processing, integration, and transformation using tools such as Apache Spark, PySpark, Python, Databricks, and SQL Server. Skilled in cloud data platforms like AWS (S3, Glue, Athena) and GCP. Strong background in writing optimized SQL queries and overseeing data flows for analytical and business use cases. Passionate about constructing high-performance data systems to facilitate strategic business decisions.
Overview
10
10
years of professional experience
Work History
Data Engineer
Saama Technologies
04.2023 - Current
- Project: ACW | Client: Ascension
- Built scalable data pipelines using PySpark on Databricks for healthcare data transformation
- Standardized raw data from multiple payers as per mapping specifications
- Implemented domain-specific data validations and authored unit test documentation
Data Engineer
Accenture
09.2021 - 12.2022
- Project: GBS | Client: Cigna
- Developed ETL pipelines to convert raw data into FHIR-compliant JSON using PySpark
- Utilized AWS Glue for job orchestration and scheduling
- Participated in data quality validation and unit testing
Data Engineer
Agilisium
08.2020 - 08.2021
- Project: GDNA | Client: Amgen
- Developed automation scripts using Databricks REST API to monitor and optimize compute resource usage
- Created analytical dashboards and cluster cost reports using PySpark
- Scheduled and managed jobs using cron
Data Engineer
Tech Mahindra Ltd
04.2019 - 07.2020
- Project: Product Planning & Data Analytics | Client: Nissan
- Designed and developed Spark-based data pipelines to analyze vehicle price competitiveness
- Processed structured and unstructured datasets using Hadoop and Spark
- Scheduled ETL workflows using Oozie
SQL/Data Engineer
CVIAC Consulting Pvt Ltd
07.2015 - 03.2019
- Project 1: Allegis Global Solutions
- Developed stored procedures, views, and backend data logic for HR and payroll applications
- Maintained and troubleshot data modules, and created job alerts for scheduled tasks
- Project 2: Dubai Transport (Dutco Group)
- Designed backend data flows and performed unit testing across payroll and time management systems
- Created reusable database scripts and resolved production issues
Education
Bachelor of Engineering - Electronics And Communication Engineering
Magna College of Engineering, Anna University
Chennai, India 04.2001 -
Skills
Data Engineering & Big Data: Apache Spark, PySpark, Hadoop, HDFS and Databricks
Programming: Python
Databases: MS SQL Server, Hive
Cloud Platforms: AWS (S3, Glue, Athena), GCP ( Big query, Dataproc, Dataform)
Workflow Orchestration: AWS Glue Jobs, Oozie, Cron and Airflow
Tools & Environments: Databricks, Hortonworks, Jupyter Notebook and SQL Server 2012/2008
Operating Systems: Windows and Linux
Version Control & CI/CD: Git and Jenkins
Disclaimer
I hereby declare that the above information is true and correct to the best of my knowledge and belief.
Timeline
Data Engineer
Saama Technologies
04.2023 - Current
Data Engineer
Accenture
09.2021 - 12.2022
Data Engineer
Agilisium
08.2020 - 08.2021
Data Engineer
Tech Mahindra Ltd
04.2019 - 07.2020
SQL/Data Engineer
CVIAC Consulting Pvt Ltd
07.2015 - 03.2019
Bachelor of Engineering - Electronics And Communication Engineering
Magna College of Engineering, Anna University
04.2001 -