Summary
Overview
Work History
Education
Skills
Accomplishments
Personal Information
Certification
Timeline
AdministrativeAssistant
Karthikeyan S

Karthikeyan S

Data Engineer
Vellore

Summary

Results-driven Azure Data Engineer & Technical Lead with 11 years of experience in designing, developing, and optimizing data-driven solutions. Expertise in Azure Data Engineering, ETL pipeline development, big data processing, and automation across financial and logistics domains. Skilled in handling large-scale datasets, building end-to-end data solutions, and implementing cost-effective automation strategies.

Proven ability to lead data transformation initiatives, streamline data ingestion, processing, and analytics, and develop custom automation tools to enhance operational efficiency. Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, PySpark, SQL, T-SQL, Delta Lake, Power BI, and Informatica.

Passionate about data-driven decision-making, process automation, and optimizing enterprise data architectures to drive business growth and efficiency

Overview

11
11
years of professional experience
4
4
years of post-secondary education
1
1
Certification
2
2
Languages

Work History

Data Engineer

Maersk GSC
03.2023 - Current
  • Designed and automated logistics processes, including automated PR creation in the portal and expense cancellation, with dynamic rate calculations based on user rate sheets.
  • Developed automation solutions for rate calculations, improving efficiency and accuracy in logistics production workflows.
  • Worked on large-scale datasets (Comet & Comet Itinerary) to track container activity and calculate rates for various material types.
  • Designed analytical tools to monitor and optimize container utilization, identifying underused containers in terminals to accelerate container movement.
  • Tech Stack: SQL, T-SQL, PySpark, Azure ADF, Azure Databricks, Azure Data Lake, Delta Lake, Power BI.

Senior Consultant

Ernst & Young Pvt. ltd
01.2019 - Current
  • Designed and implemented an end-to-end data pipeline integrating multiple source systems (MXP, Sharp, Syspro) into Azure Data Lake (ADLS Gen2).
  • Developed PySpark-based ETL processes for data ingestion, enrichment, and transformation, ensuring seamless integration with Azure Data Warehouse (DWH).
  • Automated data processing using Azure Data Factory (ADF) V2, achieving a zero-touch workflow with real-time alert mechanisms (SMS notifications) for failure monitoring.
  • Optimized T-SQL-based data transformations in the DWH zone, enabling efficient data joins and aggregations for reporting and analytics.
  • Implemented ML-based data enrichment using Python, ensuring data compatibility with Salesforce Analytical Layer.
  • Enabled reporting and visualization through Microsoft Power BI, improving data-driven decision-making.
  • Tech Stack: Azure Data Lake, ADLS Gen2, Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, PySpark, Python 3.5, Azure DevOps.databricks

Senior Developer

Standard Chartered Global Business Services
01.2014 - 01.2019
  • Designed and implemented ETL transformations in PySpark, efficiently processing large-scale datasets from multiple source systems for analytical storage.
  • Developed an in-house Python tool to convert multi-tab Excel files into a single file, streamlining the onboarding process for multiple reconciliations in Informatica.
  • Built a Python-based Crystal Reports clone, eliminating dependency on SAP/Crystal Reports (licensed software) and significantly reducing costs.
  • Optimized data processing pipelines to enhance performance, storage efficiency, and analytical accessibility.
  • Tech Stack: Azure Data Lake, Azure Data Factory (ADF), Azure Databricks, PySpark, Python, Informatica, SAP Crystal Reports, Microsoft Power BI.

Education

B.E - COMPUTER SCIENCE&ENGINEERING

VELAMMAL ENGINEERING COLLEGE
01.2010 - 01.2014

HSSC - undefined

SUNBEAM MATRIC HIGHER SECONDARY SCHOOL

Skills

Python

undefined

Accomplishments

  • Won Mr. Techie (Overall topper) award in Standard Chartered Scope International Training Program, 2014
  • Won award for delivering business solution on time for TLM rec premium migration, 2015
  • Won best award for delivering business solution prototype, 2016
  • Spot award for delivering business value
  • Kudos award for training and mentoring team
  • Very keen to learn new technology
  • Quick learner and hard worker
  • Won Best performer for Developing and Delivering python-based report to replace Crystal reports

Personal Information

  • Place of Birth: Vellore
  • Date of Birth: 09/02/92
  • Gender: Male
  • Marital Status: Married

Certification

Microsoft Certified, Azure Data Engineer Associate - Microsoft.

Timeline

Microsoft Certified, Azure Data Engineer Associate - Microsoft.

06-2024

Data Engineer

Maersk GSC
03.2023 - Current

Senior Consultant

Ernst & Young Pvt. ltd
01.2019 - Current

Senior Developer

Standard Chartered Global Business Services
01.2014 - 01.2019

B.E - COMPUTER SCIENCE&ENGINEERING

VELAMMAL ENGINEERING COLLEGE
01.2010 - 01.2014

HSSC - undefined

SUNBEAM MATRIC HIGHER SECONDARY SCHOOL

Similar Profiles

CREATE PROFILE
Karthikeyan SData Engineer