Summary
Overview
Work History
Education
Skills
Certification
Timeline
SeniorSoftwareEngineer

Arun VN

Senior Data Engineer
Bangalore,KA

Summary

Microsoft Azure Certified Senior Data Engineer with over five years of experience, specializing in Azure, Databricks, ETL pipelines, and data quality improvement, with experience building scalable data pipelines, automating workflows, and improving reporting accuracy.

Overview

5
5
years of professional experience
4
4
Certification

Work History

Senior Software Engineer

HCL Technologies
01.2022 - Current

Project Name : Databricks Inc (August 1st 2024 - Present)

  • Environments: Databricks, Salesforce, PagerDuty, Jira

Responsibilities:

  • Monitoring and cleansing daily data loads, ensuring high data quality and accuracy.
  • Diagnosing and resolving errors promptly to maintain seamless operations.
  • Collaborated with cross-functional teams to troubleshoot and escalate critical issues impacting data flow and reporting.
  • Ensured high levels of data quality, accuracy, and completeness across customer-facing reports and dashboards.
  • Performed root cause analysis on recurring data issues to drive long-term solutions and prevent future failure

Project Name : Travelodge (Jul 2023 - Jun 2024)

  • Environment: Azure data factory, SQL Server Management Studio, Talend Server, Power BI, Qlik Sense
  • Achievement : Live Wire Award for Best Performance H2 2024

Responsibilities:

  • Monitored and cleaned daily data loads, ensuring pipeline reliability and data integrity.
  • Diagnosed and resolved errors to maintain seamless operations.
  • Validated revenue and VAT data for accurate weekly financial reporting.
  • Built optimized data pipelines with ADF and Synapse, reducing processing time by 50%.
  • Collaborated on scalable data architectures, and enforced governance policies, improving data quality by 30%.
  • Developed SQL scripts to enhance data ingestion efficiency.
  • Actively contributed to new developments for continuous skill and project improvement.

Project Name : RACV (Royal Automobile Club of Victoria) (Mar 2022 - Jun 2023)

  • Environment: Azure data factory, Azure data lake, SQL Server Management Studio, ETL framework (Acceler8)

Responsibilities:

  • Daily production releases and also the monitoring using Azure Synapse Analytics
  • Handling the data file loads and Moveit file transfer requests for EDW ABS and EDL
  • Preparing interface agreements for the projects
  • Investigation of the failures on the pipelines in Azure data factory and all the data loads
  • Weekly release of non-production and pre-production releases.
  • Handling Custom batches using Logic apps

HCL Training :

  • Hands-on experience with Azure Data Factory, Data Lake, SQL, Synapse Analytics, Databricks, Hadoop, Scala, Hive, and Spark.
  • Covid Tracking Use Case: Implemented data cleaning and transformation using ADF, ADLS, Python (Databricks), and Synapse Analytics.
  • Capstone Project: Performed analytics on call/message datasets using Hive and Spark, stored outputs in Parquet format.

Business Analyst

Mantle Solutions, Lulu Cyber tower II, Infopark, Kochi, Kerala
Kochi
02.2021 - 12.2021
  • Achievement : Star of the month November 2021
  • Responsibilities:
  • Investigate and identify root cause of concerns for Lulu web-stores in UAE, Qatar, AUH, Kuwait, Dubai .etc.
  • Collect data and prepares status reports and updates the same to the Management team.
  • Manages and tracks the productivity of customer service team.
  • Assess change-proposals and define solutions to help the organization achieve its goals.

Data Analyst

Binary Fountain, Technopark, Trivandrum, Kerala
Trivandrum
01.2020 - 07.2020
  • Responsibilities:
  • Review, identify issues and take corrective actions on data processed by company’s proprietary Natural Language Processing (NLP) engine.
  • Investigate and identify root cause for NLP misses and errors, suggest corrective actions for recurring discrepancies
  • Collect and report on real-time quality metrics
  • Help identify process improvement opportunities

Data Validation - Trainee

Benefitalign Technologies (Speridian Technologies), Technopark, Trivandrum, Kerala
Trivandrum
10.2019 - 01.2020
  • Responsibilities:
  • Focused on Truecoverage portal, mobility solutions for Healthcare Payers Providers and Public Sector
  • Collect data and processing operations
  • Offers cloud based solutions for Healthcare Payers and Providers serving enterprise customers

Education

B.Tech - Electronics and Communication

Vinayaka Mission University
AVIT, Chennai
01.2019

12 th -

Kerala State Board
Thrissur
01.2015

S.S.L.C -

Kerala State Board
Thrissur
01.2013

Skills

  • Cloud and data engineering: Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Databricks
  • Database and ETL tools: SQL Server Management Studio, Talend, Hive, Spark, Hadoop
  • Programming languages: Python, Java, HTML, C
  • BI and visualization tools: Power BI, Qlik Sense
  • DevOps tools: Salesforce, PagerDuty, Jira
  • Operating systems: Red Hat Linux, Microsoft Office Suite

Certification

  • Microsoft Certified: Azure Data Engineer Associate (DP-204)
  • Microsoft Certified: Azure Fundamentals (AZ-900)
  • Microsoft Certified: Azure Data Fundamentals (DP-900)
  • Microsoft Certified: Azure AI Fundamentals (AI-900)

Timeline

Senior Software Engineer

HCL Technologies
01.2022 - Current

Business Analyst

Mantle Solutions, Lulu Cyber tower II, Infopark, Kochi, Kerala
02.2021 - 12.2021

Data Analyst

Binary Fountain, Technopark, Trivandrum, Kerala
01.2020 - 07.2020

Data Validation - Trainee

Benefitalign Technologies (Speridian Technologies), Technopark, Trivandrum, Kerala
10.2019 - 01.2020

B.Tech - Electronics and Communication

Vinayaka Mission University

12 th -

Kerala State Board

S.S.L.C -

Kerala State Board
Arun VNSenior Data Engineer