Raja Sekhar Reddy
Bangalore
Summary
Results-driven Azure Data Engineer with TCS, skilled in designing end-to-end data pipelines and optimizing SQL queries. Proven ability to enhance data quality and performance through innovative solutions. Adept in Azure Data Factory and Databricks, with strong communication skills to effectively collaborate with offshore teams.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Azure Data Engineer
TCS
Bangalore
10.2022 - Current
- Monitoring ADF Pipelines Daily/weekly/monthly loads and identifying the failed pipelines and doing the analysis for the failures.
- Daily Communication to the offshore team regarding the status of the work and support activities.
- Scheduled pipelines with the help of triggers.
- Using SSMS we need to find out if any tables or stored procedures have failed.
- We need to verify whether the data exists on both the Source side and the Data Lake side.
- I have taken ownership of the OMP module, retrieved the files from the source side, uploaded them to the containers, and notified the product owner of any pipeline failures.
- Designed and developed end-to-end data pipelines using Azure Data Factory to ingest data from multiple sources, perform transformations in Azure Databricks, and load curated data into Azure Synapse Analytics.
- Developed and optimized SQL queries and Databricks notebooks for data cleansing, transformation, and aggregation, ensuring high data quality, performance tuning, and reliable downstream reporting.
- Bekaert is a global leader in material science of steel wire transformation and coating technologies.
- Environment: Azure Data Factory, Azure Data Bricks, Azure synapse, SQL & PySpark language
Data Engineer
TCS
Bangalore
09.2022 - 10.2023
- Testing the migrated pipelines.
- Creating delta tables using Azure Databricks.
- Making notebook changes if required.
- Triggering and monitoring the pipeline runs.
- Validating the data JNJ and Kenvue environment using the test tool Spydr.
- Diamond Customer 360 was focused on migrating the JNJ data to the new consumer called Kenvue.
- Environment: Azure Data Factory, Azure Data Bricks, Azure synapse tables
Assistant control officer (ACO)
Reliance
Hyderabad
06.2020 - 09.2021
- Works in the network operations Centre/Data Centre operations.
- Monitors servers, storage and network devices.
- Handles shift operations – Monitoring alerts, incident logging, and escalation.
- Ensures uptime and availability of data Centre infrastructure.
- Coordinate with senior engineers for trouble shouting and resolution.
- Prepare daily reports on performance, outages, and health service.
- To design, implement and maintain a highly secure, scalable, and resilient data center environment for hosting mission-critical applications, enterprise workloads, and IT infrastructure for Reliance and its Clients.
Education
Bachelor’s degree - B. Tech
Jawaharlal Nehru Technological University
Kakinada01.2019
Skills
- SQL (T-SQL, My-SQL)
- Python
- PySpark (Databricks)
- Azure SQL
- MySQL
- SQL SERVER
- Azure Data Factory
- Data Flows
- Azure Data Lake
- Logic Apps
- Jupiter Notebook
Certification
- Azure Data Fundamentals (AZ-900), Microsoft
- Data bricks Lake House Fundamentals, Databricks
- Get started with Databricks for Data Engineering, Databricks
Languages
- SQL (T-SQL, My-SQL)
- Python
- PySpark (Databricks)
Timeline
Azure Data Engineer
TCS
10.2022 - Current
Data Engineer
TCS
09.2022 - 10.2023
Assistant control officer (ACO)
Reliance
06.2020 - 09.2021
Bachelor’s degree - B. Tech
Jawaharlal Nehru Technological University