Key Expertise Having total 4.4 years of professional IT experience as a Project support and Developer involved in extensive usage of Azure Data Factory, Azure Databricks, Pyspark and SQL. Hands on experience with ADF Pipelines, Pyspark and SQL. Created 20+ ADF pipelines written several sql queries. Having Basic knowledge in Python programming language. Developed data pipelines using ADF to ingest, Databricks-Pyspark to transform data. Extensive experience on ADF Pipelines optimization, query optimization. Extensive experience on ADB Notebooks. Experienced in having interactions with Business Analysts and Solution Architect to understand the project requirements and technical specifications. Experienced in both development and supporting projects and experience with both Agile continuous and waterfall methods. A positive and pro-active attitude, excellent analytical and interpersonal skills Strong interpersonal and communication skills and a committed team player. Independent and self-motivator. Have knowledge on Data warehouse concepts. SQL: Strong experience with SQL Server in creating & modifying Stored Procedures and Views. Strong experience in using complex joins for retrieving data from multiple tables. Good knowledge and working experience on Temp Tables and Functions. Strong experience in query optimization.
Hi, I’m
SURYA KIRAN PAMIDALA
Azure Developer
Hyderabad
Summary
Overview
5
years of professional experience
7
years of post-secondary education
Work History
INFOSYS
Azure Developer
10.2022 - Current
Job overview
- 4.8 YEARS
- Design and Implementation of pipelines in Azure Data factory (ELT Approach) and transformation of raw data using Azure Databricks
- Framework creation which Automates the data extraction from various heterogenous sources and exposing the data using Databricks delta table
- Metadata driven and no code approach framework in executing the ELT workloads for both milestone and incremental loads
- Scalable and Reusable ADF pipelines for data ingestion and handling structured /semi structured data Sources
- Hands-on Experience in Azure Data Lake storage, logic apps and Azure synapse
- Handling the Notebooks, Clusters, cluster pools and jobs in Azure Databricks
- Transformation and Analysing the Data using Spark SQL in Azure Databricks
- Have Understanding on Azure Synapse
- Understands Scala concepts in databricks and implementation using Databricks notebooks.
CAPGEMINIHYDERABAD
Azure Developer
09.2021 - 10.2022
Job overview
WIPROHYDERABAD
Data Engineer
06.2018 - 09.2021
Job overview
Education
VIGNAN UNIVERSITY
B.Sc. from COMPUTERS
06.2015 - 05.2018
University Overview
GPA: 79.3
Sri Chaitanya Balaji Jr
Intermediate
01.2012 - 04.2014
University Overview
GPA: 85
Bhashyam High School
SSC
01.2011 - 04.2012
University Overview
GPA: 8.5
Skills
Windows 2000/Server 2003/2007undefined
Accomplishments
Accomplishments
- Project 1:
- Project Title : EIM-DM Development
- Client : Molina Healthcare Limited
- Role : Azure Data Engineer
- Team Size : 34
- Environment : Azure Data Factory, Azure Data Lake, Databricks, SSMS, Azure Data Lake,
- Client Overview
- This project focuses on migrating the on-premise Enterprise Data Warehouse to Cloud using Microsoft Azure technologies
- It will include rewriting the whole solution using Azuretechnologies, migrating all the data from various disparate legacy source systems, interacting with Business getting and finalizing business requirements and finally integrating and testing the whole solution
- Roles & Responsibilities:
- Understanding requirements & business logics and prepared design and requirement analysis document
- Created ADF pipelines for data movement from heterogeneous sources to Azure data stores
- Migrated on-premises sql server to Azure cloud
- Developed ETL integration patterns using Python on Spark in Databricks
- Created ETL Batch process, configuration and Audit log tables
- Created dynamic pipeline to load multiple tables of different structure in parallel
- Created automatic and event based triggers
- Involved in creating CI/CD pipelines to deploy ADF pipelines to other data factory instances
- Active support on Production pipelines
- Written notebooks to process data using pyspark
- Implemented complete end to end data process in Azure delta lake PROJECT DETAILS
- Project 2:
- Project Title : ADNIC
- Client : Abu Dhabi national insurance Corporation
- Role : Azure Developer
- Team Size : 40
- Environment : Azure Data Factory, Azure Data Lake, Databricks, Azure Sql,
- SSMS
- Roles & Responsibilities:
- Gathered business requirements from different user groups
- Designed various ingestion and processing patterns based on use cases
- Written notebooks to process data using Pyspark
- Implemented complete end to end data process in Azure data lake
- Built complex data ingestion/process frameworks using Azure Databricks/python/pyspark
- Orchestrated the end to end data integration pipelines using data factory PROJECT DETAILS
- Project 3:
- Project Title : EGP Data Migration
- Client : Molina Health care limited
- Role : Azure Developer
- Team Size : 18
- Environment : Azure Data Factory, Azure Data Lake, Databricks, Azure Sql,
- SSMS
- Roles & Responsibilities:
- Collaborate with the Quality Assurance Team on issue reporting, resolution, and change management
- Analysis and Design – Converts high-level design to low-level design and implements it
- Using Microsoft platform technologies and Azure, design, build and modify existing business-tier components, Web applications, and database objects
- Run unit and integration tests on all created code – Create and run unit and integration tests throughout the development lifecycle
- Solid knowledge of SDLC and agile techniques (P.SURYA KIRAN)
Timeline
Azure Developer
INFOSYS
10.2022 - Current
Azure Developer
CAPGEMINI
09.2021 - 10.2022
Data Engineer
WIPRO
06.2018 - 09.2021
VIGNAN UNIVERSITY
B.Sc. from COMPUTERS
06.2015 - 05.2018
Sri Chaitanya Balaji Jr
Intermediate
01.2012 - 04.2014
Bhashyam High School
SSC
01.2011 - 04.2012
Similar Profiles
CHETAN SONAWANECHETAN SONAWANE
Lead Technical Consultant at InfosysLead Technical Consultant at Infosys
Ved ShuklaVed Shukla
Senior System Engineer at InfosysSenior System Engineer at Infosys
ASMITA KULKARNIASMITA KULKARNI
Consultant at InfosysConsultant at Infosys
Madhugeetha AkkisettyMadhugeetha Akkisetty
Production Support Lead at InfosysProduction Support Lead at Infosys
S N Aditya MurthyS N Aditya Murthy
Lead Product Manager - Digital Supply Chain at Dr Reddy's LaboratoriesLead Product Manager - Digital Supply Chain at Dr Reddy's Laboratories