Summary
Overview
Work History
Education
Skills
Certification
Languages
Accomplishments
Timeline
Generic

DHEENDHAYALAN MAHENDRAN

Puducherry

Summary

Senior Data Engineer with 7 years of experience in designing and implementing robust data pipelines (ETL/ELT) across on-premise and cloud environments (Azure, AWS, Snowflake). Proficient in HDFS, PySpark, Spark, SQL, DWH, and Git, with a proven ability to collaborate effectively with cross-functional teams to deliver high-quality data solutions.

Overview

7
7
years of professional experience
1
1
Certification

Work History

Senior Data Engineer

Tiger Analytics India Consulting Pvt. Ltd.
Chennai
02.2023 - Current
  • Delivered highly efficient data pipelines built using Azure Databricks, Snowflake, and Azure Data Factory, with Git version control, providing 45% more efficiency in processing time.
  • Improved data lake efficiency by 35% by designing and implementing data ingestion pipelines using AWS S3, AWS Glue, and AWS Lambda.
  • Conducted performance tuning on SQL queries, optimizing data retrieval by 20%.
  • Improved data accuracy by 15% by implementing data quality checks.
  • Developed comprehensive technical documentation, including Business Requirements Documents (BRDs), Design Specifications and Unit Test Plans.

Data Engineer

Tata Consultancy Services
Chennai
07.2021 - 02.2023
  • Collaborated on the design and implementation of robust data solutions, encompassing data modeling, data warehousing and ETL pipeline development
  • Implemented ETL solutions with 30% more efficiency using Microsoft Azure Services (ADLS Gen2, ADF, ADB, Synapse) in an Agile methodology.
  • Reduced redundant activities of 3 departments by Building Data Warehouse including Slowly Changing Dimensions (SCD Type 2).
  • Involved in POC for Data migration from legacy system to Amazon AWS using S3, Glue, AWS Databricks, RDS, delivering 70% more efficiency.

Software Programmer

Roadmap IT Solutions Pvt. Ltd.
Puducherry
07.2018 - 06.2021
  • Developed three ERP projects for three different clients in a short span of six months each from scratch.
  • Developed scalable database solutions using Oracle PL/SQL and SQL, including data migration scripts, and reporting functions for ERP projects.
  • Actively participated in requirements gathering and analysis sessions, contributing to the development of clear and concise design documentation, and unit test cases.

Education

B. TECH - ECE

ALPHA College of Engineering & Technology (Affiliated To Pondicherry University)
Puducherry
05.2018

Skills

  • CLOUD TECHNOLOGY: Microsoft Azure, Amazon AWS, Snowflake
  • DISTRIBUTED SYSTEMS: HDFS, Databricks, PySpark, Spark-SQL, Kafka, Spark Streaming
  • PROGRAMMING: Python, SQL, PL/SQL, performance tuning
  • DATA WAREHOUSING/ETL: Data/Dimensional Modeling, DWH, ETL, ADF, AWS Glue, SCD (Type - 2)
  • DATABASES (RDBMS): Oracle, SQL Server, MySQL
  • VERSION CONTROL: Git
  • PROJECT MANAGEMENT: Agile Methodology - Jira

Certification

  • Snowflake SnowPro Core (COF-C02)
  • Azure Data Engineer Associate (DP-203)
  • Azure Fundamentals (AZ-900)

Languages

English, Tamil

Accomplishments

ON THE SPOT AWARD for quick learning & implementing cloud & ETL Technologies | TCS | 2022

Timeline

Senior Data Engineer

Tiger Analytics India Consulting Pvt. Ltd.
02.2023 - Current

Data Engineer

Tata Consultancy Services
07.2021 - 02.2023

Software Programmer

Roadmap IT Solutions Pvt. Ltd.
07.2018 - 06.2021

B. TECH - ECE

ALPHA College of Engineering & Technology (Affiliated To Pondicherry University)

Similar Profiles

CREATE PROFILE
DHEENDHAYALAN MAHENDRAN