Hari Gautham K N
Chennai
Summary
Experienced data engineer with a strong track record in SQL query optimization and ETL process enhancement at EY GDS India LLP. Skilled in Databricks, Microsoft Fabric, Azure SQL, and PySpark, focusing on effective data integration, data governance and orchestration. Proven ability to drive business performance through innovative data solutions and a collaborative work ethic.
Overview
6
6
years of professional experience
6
6
Certifications
Work History
Data Engineer
EY GDS India LLP
Chennai
01.2025 - Current
- Analyzed user requirements and designed ETL processes for enterprise data loading.
- Designed data warehousing solutions using dimensional modeling techniques for optimized access.
- Enhanced SQL queries and database schemas, resulting in efficient data retrieval operations.
- Optimized existing queries and improved performance through strategic indexing on tables.
- Collaborated with cross-functional teams to define technical specifications, ensuring alignment with business needs.
- Worked alongside data scientists and analysts to implement effective data models.
- Participated in agile development processes, contributing to sprint planning and reviews to streamline project workflows.
- Documented data architecture designs, facilitating knowledge transfer and ensuring maintainability for future enhancements.
- Provided technical mentorship to junior data engineers, guiding them on best practices and project execution.
Data Engineer Analyst
Accenture Solutions Pvt Ltd
Chennai
02.2022 - 01.2025
- Directed and executed the migration of various on-premises ETL jobs to Azure cloud, ensuring a smooth transition and minimal disruption
- Migrated data operation to cloud over 8 different lines of business
- Formulated strategic plans to ensure a seamless and efficient transition to the Azure cloud environment.
- Analyzed complexities of migrating on-premises jobs to Azure, identifying key challenges and solutions for a smooth transition.
- Implemented a customized ETL Framework to streamline and optimize the migration process
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
- Designed and implemented Azure Data Factory pipelines, optimizing data extraction, transformation, and loading processes
- Developed architecture for Azure Data Factory to support data integration workflows.
- Orchestrated data movement from diverse upstream sources, processed data according to business logic, and loaded it into Azure Data Lake and Azure Synapse
- Utilized Azure Data Factory to efficiently extract and copy data from a variety of sources, enhancing data accessibility and integration
- Implemented data extraction processes from sources like HDFS and Salesforce, ensuring seamless integration with Azure Data Lake Storage
- Engineered external PySpark modules within Azure Databricks, enabling flexible and tailored data transformations
- Aligned PySpark module development with specific business requirements, ensuring accurate and meaningful data transformations
- Implemented efficient processes to transform diverse file formats into Delta tables, enhancing data consistency and accessibility
- Automated creation of external tables in Azure Databricks, enhancing scalability and reliability of data access.
- Successfully loaded data into destination platforms such as Oracle databases, Tibco mailboxes, and Azure Synapse Data Warehouse, using Azure Data Factory
- Implemented rigorous testing and validation processes, ensuring the accuracy and reliability of both source and target data
- Developed orchestration framework to automate job schedules, streamlining data loads and improving workflow efficiency.
- Ensured systematic and efficient execution of data processing tasks through comprehensive orchestration
- I oversaw the deployment of code artifacts from Azure Data Factory, Azure Databricks, and Azure SQL to maintain a streamlined and automated deployment process
- Engaged in continuous improvement initiatives to enhance system stability and address emerging technical challenges.
- Engaged in continuous improvement initiatives to enhance system stability and address emerging technical challenges.
Product Development Engineer
DOTNDASH IoT
Chennai
06.2020 - 07.2021
- Involved in designing and implementing home IoT products
- Used python and arduino programming to load programs onto ESP 8266.
- Pitched in financial planning of products
- Took part in setting up cloud environment to log sensor data and consumption report of electricity.
- Collaborated with cross-functional teams to optimize overall product functionality and user experience.
Education
Executive MBA -
Indian Institute of Management
Visakhapatnam03-2026
Master of Science - Automotive Engineering Technology
University of Windsor
Windsor, Canada05-2020
Bachelor of Science - Mechatronics Engineering
SRM University
Chennai, India05-2017
Skills
- ETL processes
- Data warehousing
- Data migration
- Data orchestration
- Big data processing
- PySpark
- Azure Data Factory
- SQL optimization
- Database management
- Data governance
- Data mining
- Python programming
- Agile methodologies
- Team management
Certification
Databricks Certified Data Engineer Professional
Timeline
Data Engineer
EY GDS India LLP
01.2025 - Current
Data Engineer Analyst
Accenture Solutions Pvt Ltd
02.2022 - 01.2025
Product Development Engineer
DOTNDASH IoT
06.2020 - 07.2021
Executive MBA -
Indian Institute of Management
Master of Science - Automotive Engineering Technology
University of Windsor
Bachelor of Science - Mechatronics Engineering
SRM University