Kavya Padmanabhan
Kerala
Summary
Highly skilled and experienced Azure Data Engineer with a solid background in designing, developing, and implementing data solutions on the Microsoft Azure platform. Possessing four years of professional expertise, I have a strong understanding of data engineering concepts, cloud technologies, and data management best practices.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Azure Data Engineer, Microsoft
Tech Mahindra(Payroll company)
Bangalore
08.2021 - 02.2025
- Collaborate with client developers at Microsoft to develop, debug, and optimize ETL data pipelines, identify and troubleshoot issues causing pipeline failures, and pinpoint the exact failure points while devising optimization strategies to prevent recurring errors. Assist developers in maintaining the health of their pipelines.
- Provide end-to-end support for data pipelines using Azure Data Factory, and optimize the performance of pipelines within the Azure cloud environment.
- Utilize various connectors, including SAP, Snowflake, SQL Server, Fabric, FTP, SFTP, B, Azure Databricks, Azure Data Lake, Blob, and Azure Synapse, to establish a secure connection within Azure Data Factory.
- Identified a bug in the Azure Data Factory product and highlighted it to the product team.
Azure Data Engineer
Wipro
Bangalore
03.2019 - 07.2023
- Created Azure data factory pipelines to pull data from on-premise Oracle database, and Azure SQL DB to Azure Data Lake storage as a full load daily into corresponding folders.
- Extracted data from various sources like MS-Sql server, Manual files, and Blob Storage.
- Having experience in transforming and loading data into Delta tables in Azure Databricks.
- Good understanding of storing and reading data from cloud storage like Azure blob storage.
- Implement robust ETL processes to handle large volume of data for both full load and incremental load scenarios.
- Designed data pipelines for efficient data integration and processing.
Education
Bachelor of Technology - Computer Science
Vimal Jyothi Engineering College
Kerala09-2020
Skills
- Azure Data Factory
- Azure Databricks
- ETL
- PySpark,
- SQL
- Python
- Azure Synapse Analytics
- Scala
- KQL
Certification
- Microsoft Certified Azure Data Fundamentals (DP-900)
- Microsoft Certified Azure Fundamentals (AZ-900)
- Databricks Certified Data Engineer Associate
- Microsoft Certified Data Engineer Associate
Timeline
Azure Data Engineer, Microsoft
Tech Mahindra(Payroll company)
08.2021 - 02.2025
Azure Data Engineer
Wipro
03.2019 - 07.2023
Bachelor of Technology - Computer Science
Vimal Jyothi Engineering College
Similar Profiles
VISHNU RAMKISAN INGOLEVISHNU RAMKISAN INGOLE
Senior Network Engineer at Tech Mahindra, Payroll by RLAB (Client- Mahindra & Mahindra)Senior Network Engineer at Tech Mahindra, Payroll by RLAB (Client- Mahindra & Mahindra)
SHASHI SHARMASHASHI SHARMA
Senior Software Test Engineer at Comviva Mahindra (A Tech Mahindra Company)Senior Software Test Engineer at Comviva Mahindra (A Tech Mahindra Company)
Dorothy SharmaDorothy Sharma
Manager -HRBP at Comviva Technologies (A Tech Mahindra Company)Manager -HRBP at Comviva Technologies (A Tech Mahindra Company)
TINTO JOSEPHTINTO JOSEPH
Program Assistant – Project Administration & Opera at Public Health Foundation of IndiaProgram Assistant – Project Administration & Opera at Public Health Foundation of India
Ramees PaRamees Pa
Procurement & Sales Executive at Asian Sales Corp.Procurement & Sales Executive at Asian Sales Corp.