Shekar Raparthi
Hyderabad
Summary
Results-driven Azure Data Engineer with 3.5 years of experience in designing, developing, and optimizing data pipelines using Azure Data Factory (ADF), Azure Databricks, PySpark, SQL, and Azure Synapse Analytics. Skilled in building ETL processes, data lakes, and cloud-based solutions to enhance business intelligence and analytics. Passionate about implementing scalable data architectures and automation for real-time and batch processing.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Azure Data Engineer
Accenture
Hyderabad
12.2021 - Current
- Designed and implemented data integration pipelines using Azure Data Factory (ADF) to extract data from various sources.
- Developed optimized data transformation workflows using Azure Databricks, PySpark, and SQL.
- Implemented real-time data processing solutions using Azure Stream Analytics and Delta Lake.
- Integrated ADF with multiple data sources to ensure efficient and reliable data flow.
- Developed and deployed PySpark code for large-scale data processing workloads in Databricks.
- Integrated Azure Data Lake Storage Gen2 (ADLS Gen2) and external databases for seamless data access.
- Designed and implemented ETL pipelines using ADF and Databricks, improving data processing efficiency by 40%.
- Extracted, transformed, and loaded (ETL) data from CSV, JSON, Excel, and Parquet into Azure Data Lake Storage.
- Created ADF pipelines, linked services, datasets, and triggers for automated data workflows.
- Configured Integration Runtimes (self-hosted and Azure) to enable seamless data movement.
- Scheduled and monitored pipeline execution using different triggers for improved data orchestration.
- Implemented Azure Synapse Analytics solutions to enhance analytical reporting and business insights.
- Automated data ingestion workflows using ADF pipelines reduce manual efforts by 50%.
- Managed storage accounts, containers, blobs, and ADLS Gen2 for structured and unstructured data storage.
- Developed and optimized PySpark jobs for transforming and aggregating large datasets.
- Collaborated with data analysts and business teams to deliver clean, structured datasets.
Education
B.Com (Computer Applications) -
Osmania Unversity
Hyderabad, India08-2021
Skills
- Programming languages: Python, SQL
- Data Engineering Tools: PySpark, Azure Data Factory, Azure Databricks, and Azure Synapse Analytics
- Tools and Technologies: Power Apps, Power Automate, SharePoint
Accomplishments
- Top 5 finalist in the Innovation Contest: developed a tool using Power Apps, Power Automate, and SharePoint, aimed at reducing manual work and improving efficiency The tool was recognized as one of the top five innovations in an internal contest
- Process Automation Achievement: Successfully implemented automation solutions that streamlined operations, reduced manual effort, and improved productivity
- Technology-Driven Impact: Contributed to digital transformation within the organization by leveraging the Microsoft Power Platform for process optimization
Certification
- AZ-900: Azure Fundamentals
- DP-203: Azure Data Engineer Associate
- DP-100: Microsoft Certified Azure Data Scientist Associate
- Databricks Data Engineering Associate
Timeline
Azure Data Engineer
Accenture
12.2021 - Current
B.Com (Computer Applications) -
Osmania Unversity
Similar Profiles
JESWIN JAINJESWIN JAIN
Performance Tester at AccenturePerformance Tester at Accenture
Amanjot Kaur LambaAmanjot Kaur Lamba
Workday Integration Consultant at AccentureWorkday Integration Consultant at Accenture
Sumit PatilSumit Patil
SAP Security and GRC Consultant at AccentureSAP Security and GRC Consultant at Accenture
Sajal BhardwajSajal Bhardwaj
People Advisor Analyst, HRBP at AccenturePeople Advisor Analyst, HRBP at Accenture
Suresh BhumireddySuresh Bhumireddy
Technical Specialist at Bosch Global Software TechnologiesTechnical Specialist at Bosch Global Software Technologies