Kavitha Balasubramaniyan
Data Engineer
Chennai,TN
Summary
Overall 6 Years of experience in Development. Around 3 Years of Experience in the field of Data Analytics in Spark SQL, Scala,Python and 3 Years of Experience in .Net Technology. Worked in Data transformation part using Azure Cloud technologies like Azure Data Factory, Azure Data Bricks and Azure Data Lake extensively. Knowledge on Scala,Python, C# .Net and Strong skills in SQL development. Experienced in high end Enhancement and maintenance project activities thereby meeting the requirements of the client effectively and efficiently. Experience in application deployment on Development, Testing and production environments and following the change and release management process. Experienced Application development and maintenance support which provide user & production maintenance, to clients handling critical issues and providing speedy deliveries. A thorough professional with a proactive attitude, capable of thinking in & out of the box. Strong interpersonal and communication skills and the ability to work effectively with a wide range of corporate across industries and countries.
Overview
6
6
years of professional experience
4
4
years of post-secondary education
Work History
Senior Analyst
Latentview Analytics Ltd
09.2024 - 10.2025
- Responsible for orchestrating end-to-end data workflows using Azure Data Factory (ADF).
- Designed ADF pipelines integrating linked services, datasets, activities, and triggers.
- Implemented schedule-based and event-based triggers for automated data delivery.
- Created and managed Databricks notebooks using Python and Spark SQL.
- Optimized Databricks jobs for handling large structured and semi-structured datasets.
- Implemented metadata-driven frameworks using control, mapping, and audit tables.
- Automated ETL/ELT workflows by integrating ADF with Databricks.
- Developed and optimized stored procedures in Azure SQL Database.
- Implemented logging and auditing mechanisms for pipeline execution tracking.
Data Bricks Developer
Perficient India Pvt Ltd
10.2022 - 03.2023
- Source files will be stored in the S3 bucket.
- For incremental data, we process both weekly and daily files.
- Weekly and historical data from ODH are appended to the Analytical Data Hub (ADH), excluding daily data.
- The historical load will occur as a one-time process.
- Tables are loaded using Spark applications and SQL scripts.
- These jobs are scheduled using Stonebranch workflows.
- Exerts good project management skills on the assigned projects, conducts reviews with stakeholders, provides regular updates to the stakeholders and functional groups; assesses risks and maintains action trackers and project documentation.
Azure Data Bricks and Azure Data Factory Developer
Capgemini India Pvt Ltd
06.2021 - 10.2022
- Responsible for orchestrating using Azure Data Factory (ADF) and performing data transformations with Azure Databricks (ADB) using Scala and SQL coding languages.
- Implemented ADF-linked services, datasets, pipelines, activities, and triggers.
- Involved in data migration from the Universal Data Lake to the Business Data Lake (level 1) and from the Business Data Lake to the Business Data Lake (level 2).
- Developed pipelines in Azure Data Factory, monitored their execution, and resolved issues upon pipeline failure.
- Proficient in control flow, data flow, and transformations within ADF.
- Implemented triggers to schedule pipeline runs using both schedule-based and event-based triggers.
- Possess basic knowledge of creating notebooks with Azure Databricks using Spark SQL functions.
- Familiar with deploying code in Git repositories using Azure DevOps.
- Conducted unit testing for developed notebooks to load data (full load, delta load as required) and pipelines on monthly, daily, and annual schedules.
- Knowledgeable about Water Mark and JMF concepts in pipeline execution.
- Experienced with using JIRA boards.
.Net Developer
Prophoenix Technologies
05.2017 - 05.2020
- Proficient knowledge in application development on Microsoft Technologies like C#.Net (3.5 & 4.5), ASP.Net, JavaScript, Ajax, SQL Server, and WebAPI.
- Analyze user requirements, design, test, and develop software to fulfill those requirements.
- Ensure software functionality through ongoing maintenance and testing, including unit and integration testing.
- Design and develop web-based, database-driven applications using the latest .NET technologies and adhering to best practices.
- Possess a solid grasp of networking principles and develop prototypes based on functional specifications.
- Evaluate and select technology components and products to enhance existing enterprise and e-commerce applications, as well as for upcoming projects.
- Proficient in SDLC and Scrum processes and skilled in root cause analysis techniques.
- Ensure all deliverables meet customer requirements and internal approval criteria, adhering to team and company guidelines and standards.
- Proactively identify and address potential issues in deliverables to prevent customer dissatisfaction.
- Manage code review and merging processes across various branches using TFS (Team Foundation Server).
- Proficient in customizing web controls, conducting code and test case reviews, and optimizing queries and coding for performance.
- Collaborate with SMEs to gather enhancement requirements and review related details.
- Maintain comprehensive knowledge of company testing procedures, processes, and tools.
- Keep developers informed about outstanding issues and take ownership until resolution.
Education
B.Tech - Information Technology
Annai College of Engineering & Technology
Kumbakonam 08.2010 - 04.2014
Skills
Microsoft-Azure Cloud Platform (Azure Databricks, Azure Data Warehouse, Azure Data Factory, Azure Data Lake), C#,ASPNet, WebAPI AWS,Redshift, Amazon S3 Bucket, StoneBranch
Timeline
Senior Analyst
Latentview Analytics Ltd
09.2024 - 10.2025
Data Bricks Developer
Perficient India Pvt Ltd
10.2022 - 03.2023
Azure Data Bricks and Azure Data Factory Developer
Capgemini India Pvt Ltd
06.2021 - 10.2022
.Net Developer
Prophoenix Technologies
05.2017 - 05.2020
B.Tech - Information Technology
Annai College of Engineering & Technology
08.2010 - 04.2014