Results-driven Azure Data Engineer with a proven track record at Helm Analytics Pvt Ltd, adept at designing end-to-end data solutions using Azure Data Factory and Delta Lake. Skilled in optimizing data pipelines and fostering collaboration, I excel in transforming complex data into actionable insights, enhancing data governance and performance.
Overview
12
12
years of professional experience
Work History
Azure Data Engineer
Helm Analytics Pvt Ltd - Elite Finance BI
Bangalore
12.2023 - 12.2024
Design and implement end-to-end data solutions for 3E & SOFTRAX servers which are in On-prem
Implemented medallion architecture with bronze, silver, and gold layers for managing the data
Worked on the Delta Lake, Delta Files, Delta Live tables, and Reference Pipelines
Worked with Unity Catalog and Collibra for data governance
Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to extract, transform and load data from various sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards
Extraction, Transformation and Loading the data using the Azure Databricks in the shared Notebooks
Worked with Unity Catalog and Collibra for data governance
Involved in migration of the pipelines/code to different environments using Azure DevOps pipelines
Optimized reference pipeline performance
Participating in Technical Architecture Documents, Project Design, and Implementation Discussions
Azure Data Engineer
Thomson Reuters International Services Private Limited - Elite Finance BI
Bangalore
01.2019 - 12.2023
Design and implement end-to-end data solutions for 3E, SOFTRAX & SALESFORCE servers which are in On-prem
Implemented medallion architecture with bronze, silver, and gold layers for managing the data
Worked on the Delta Lake, Delta Files, Delta Live tables, and Reference Pipelines
Worked with Unity Catalog and Collibra for data governance
Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to extract, transform and load data from various sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards
Extraction, Transformation and Loading the data using the Azure Databricks in the shared Notebooks
Worked with Unity Catalog and Collibra for data governance
Involved in migration of the pipelines/code to different environments using Azure DevOps pipelines
Optimized reference pipeline performance
Participating in Technical Architecture Documents, Project Design, and Implementation Discussions
Design and implement end-to-end data solutions for billing reports
Extensively working in data Extraction, Transformation and Loading from Source to target system using SQL Server 2010 Integration Services
Designed and developed SSIS Packages to process data in to Target System from source systems based on the requirements
Created, Manipulated and Deploying Packages
Scheduling Jobs (Daily/weekly/Monthly) as per the client requirement
Created various SAP BO reports according to user specifications using SAP BO and created ad hoc reports
Develop reports using SAP BO and utilizing complex SQL queries and stored procedures
Good Knowledge on Optimizing the SQL Server Queries
Senior Software Engineer
Dhruv Compusoft Consultancy Pvt. Ltd - Bharati Axa Insurance
Bangalore
11.2012 - 01.2019
Design and implement end-to-end data solutions for Finance reports
Extensively working in data Extraction, Transformation and Loading from Source to target system using SQL Server 2010 Integration Services
Designed and developed SSIS Packages to process data in to Target System from source systems based on the requirements
Created, Manipulated and Deploying Packages
Scheduling Jobs (Daily/weekly/Monthly) as per the client requirement
Created various complex reports like Form, Tabular, Drill Down, Drill Thru, Matrix and chart reports according to user specifications using SSRS and created ad hoc reports
Worked on expressions to filter, group, parameterized, cascaded parameter format of reports in SSRS
Develop reports using SQL Server Reporting Services and utilizing complex SQL queries and stored procedures
Configure and maintain Report Manager and Report Server for SSRS
Create and modify tables, stored procedures, triggers, check constraints and functions
Create triggers to keep track of changes to the fields of tables when changes are made
Good Knowledge on Optimizing the SQL Server Queries
Senior Software Engineer
GapBridge Software Service Pvt Ltd - ACN Analytics
Bangalore
06.2017 - 11.2017
Design and implement end-to-end data solutions for Finance reports
Extensively working in data Extraction, Transformation and Loading from Source to target system using SQL Server 2010 Integration Services
Designed and developed SSIS Packages to process data in to Target System from source systems based on the requirements
Created, Manipulated and Deploying Packages
Scheduling Jobs (Daily/weekly/Monthly) as per the client requirement
Created various complex reports like Form, Tabular, Drill Down, Drill Thru, Matrix and chart reports according to user specifications using SSRS and created ad hoc reports
Worked on expressions to filter, group, parameterized, cascaded parameter format of reports in SSRS
Develop reports using SQL Server Reporting Services and utilizing complex SQL queries and stored procedures
Configure and maintain Report Manager and Report Server for SSRS
Create and modify tables, stored procedures, triggers, check constraints and functions
Create triggers to keep track of changes to the fields of tables when changes are made
Good Knowledge on Optimizing the SQL Server Queries
Senior Software Engineer
IBM INDIA Pvt Ltd - Standard Insurance
Bangalore
03.2016 - 02.2017
Design and implement end-to-end data solutions for Finance reports
Extensively working in data Extraction, Transformation and Loading from Source to target system using SQL Server 2010 Integration Services
Designed and developed SSIS Packages to process data in to Target System from source systems based on the requirements
Created, Manipulated and Deploying Packages
Scheduling Jobs (Daily/weekly/Monthly) as per the client requirement
Migrate the existing crystal reports to SSRS reports
We are implemented multiple optimization techniques for SSRS reports
Education
Master Computer Applications (M.C.A) -
JNTU Anantapur
Skills
Azure SQL Database
Azure Data Lake
Azure Data Factory (ADF)
Azure Data Bricks (ADB)
Delta Lake
Azure Key Vaults
Unity Catalog
SSIS
SAP BO
SSRS
SQL SERVER
Azure Virtual Machine (VM)
Windows 10
Windows XP
UNIX
PySpark
Python
Transact SQL
PL/SQL
Oracle
Timeline
Azure Data Engineer
Helm Analytics Pvt Ltd - Elite Finance BI
12.2023 - 12.2024
Azure Data Engineer
Thomson Reuters International Services Private Limited - Elite Finance BI
01.2019 - 12.2023
Senior Software Engineer
GapBridge Software Service Pvt Ltd - ACN Analytics
06.2017 - 11.2017
Senior Software Engineer
IBM INDIA Pvt Ltd - Standard Insurance
03.2016 - 02.2017
Senior Software Engineer
Dhruv Compusoft Consultancy Pvt. Ltd - Bharati Axa Insurance