SANTHOSH R
BANGALORE
Summary
Experienced Data Engineer with over 5.5 years of overall IT experience and more than 4 years of specialized expertise in Azure Data Engineering. Proficient in designing, developing, and deploying scalable data pipelines using Azure Data Factory and Azure Databricks. Skilled in building end-to-end ETL/ELT solutions, transforming raw data into actionable insights by leveraging cloud-native services, PySpark, and Delta Lake. Adept at implementing medallion architecture, handling large volumes of structured and semi-structured data.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Senior Software Engineer
HEXAWARE TECHNOLOGIES LTD | Client - KPMG | Project: Strategic Data Transformation
Bangalore
08.2024 - Current
- Implemented pipelines to move data from on-premise SQL Server to data lake storage.
- Designed, constructed, and maintained scalable data pipelines for data ingestion, cleaning, and processing using PySpark and SQL.
- Configured triggers (schedule) to automate data ingestion and transformation processes.
- Monitored pipeline executions via the ADF monitoring hub for debugging and performance optimization.
- I analyzed the SQL scripts and designed the solution to implement using PySpark.
- Integrated Databricks with ADF for triggering notebooks from data pipelines.
Senior Consultant
WINWIRE TECHNOLOGIES | Client - Adventist Health | Project - Revenue cycle Management
Bangalore
08.2024 - 12.2025
- Created stored procedures for automating periodic tasks in SQL Server.
- Worked with Azure Storage Systems, like Azure Data Lake Store (ADLS), and Azure Blob Storage.
- Experience in implementing PySpark DataFrame, transformations, and actions to implement business analysis.
- Understanding the necessary data requirements to implement Azure Databricks solutions.
- Optimized Spark jobs using caching, partitioning, broadcast joins, and adaptive query execution for performance tuning.
- Performed aggregations, joins, and data cleansing as part of the transformation logic for reporting and analytics.
Senior Consultant
WEBAFFINITY TECHNOLOGIES | Client - Danone | Project - Cloud Data Migration
Bangalore
02.2019 - 07.2023
- Creating master pipelines in Azure Data Factory version 2.
- Implemented ETL activities using ADF pipelines to load data from on-premise source systems to Blob.
- Created linked services for multiple source systems (i.e., SQL Server, ADLS Gen2, Blob).
- Exposure to Azure Data Factory activities such as Lookup, Stored Procedure, If Condition, For Each, Get Metadata, Filter, Wait, Execute Pipeline, Copy Activity, Set Variable, Until, Switch, Custom Activity, Script Activity, Validation Activity, Delete Activity, and Trigger Activity.
Education
Bachelor of Engineering (B.E.) - Mechanical Engineering
VVIET, Mysore
Mysore06-2016
Skills
- Azure Data Factory
- Azure Databricks
- Performance optimization
- PySpark transformations
- SQL query optimization
- Azure Data Lake Store
- Azure Blob Storage
- Azure Synapse Analytics
Certification
- AZ-900: Microsoft Certified Azure Fundamentals
- DP-203: Data Engineering on Microsoft Azure
Timeline
Senior Software Engineer
HEXAWARE TECHNOLOGIES LTD | Client - KPMG | Project: Strategic Data Transformation
08.2024 - Current
Senior Consultant
WINWIRE TECHNOLOGIES | Client - Adventist Health | Project - Revenue cycle Management
08.2024 - 12.2025
Senior Consultant
WEBAFFINITY TECHNOLOGIES | Client - Danone | Project - Cloud Data Migration
02.2019 - 07.2023
Bachelor of Engineering (B.E.) - Mechanical Engineering
VVIET, Mysore
Similar Profiles
Kuruvilla PhilipKuruvilla Philip
Technical Architect at Client - KPMG Montvale | HexawareTechnical Architect at Client - KPMG Montvale | Hexaware
RIZWAN AHMEDRIZWAN AHMED
Desktop Support Engineer at Center for Railways Information Systems (CRIS) Control Office Automation Project in the HewlettPackard (Client of Sysnet Global Technologies (P) Ltd.)Desktop Support Engineer at Center for Railways Information Systems (CRIS) Control Office Automation Project in the HewlettPackard (Client of Sysnet Global Technologies (P) Ltd.)
SAGAR SHINDESAGAR SHINDE
Agribusiness Appraisal Expert at Assam Agribusiness & Rural Transformation Project(APART)- A World Bank Project. (Govt. of Assam)Agribusiness Appraisal Expert at Assam Agribusiness & Rural Transformation Project(APART)- A World Bank Project. (Govt. of Assam)
Raghu Vamsi MRaghu Vamsi M
Associate Manager- Finance at Reverie Language Technologies LimitedAssociate Manager- Finance at Reverie Language Technologies Limited
Shwetha AgarwalShwetha Agarwal
Artist Manager at Nineone IncArtist Manager at Nineone Inc