Athyusha Thota
Data Engineer
Hyderabad,TG
Summary
Experienced Azure Data Engineer with a proven track record in designing, developing, and implementing data solutions on the Microsoft Azure platform. Possesses 12 years of professional expertise and a deep understanding of data engineering concepts, cloud technologies, and data management best practices. Solid background enables effective leveraging of skills and knowledge to deliver efficient and scalable data solutions tailored to organizational needs.
Overview
12
12
years of professional experience
6024
6024
years of post-secondary education
1
1
Certification
3
3
Languages
Work History
Azure Data Engineer
Optum Global Solutions
10.2022 - Current
- Experience in creating ETL pipelines using Azure Data Factory (ADF) and Azure Synapse, end to end project implementation using ADF/Azure Synapse
- Ensured the proper storing of both raw and processed data
- Having good knowledge in Dataset, linked service, Runtime Integration, Data flow in ADF
- Developed a data quality framework utilizing tools such as Databricks (with PySpark) and Azure Data Factory
- This framework efficiently extracted data from multiple sources (SQL, ADLS, Rest API etc.) executed check rules and loaded into database
- Azure databricks is used to transform the RAW data to the cleanest form of data and then we are using Azure Synapse Analytics to load the clean data
- Implemented Azure Active Directory (AAD) and Azure Key Vault for the monitoring and governance purpose
- Created Azure data factory pipelines to pull data from on-premise Oracle database, and Azure SQL DB to Azure Data Lake storage as a full load daily into corresponding folders
- Having experience in transforming and loading data into delta tables in Azure Databricks
- Good understanding of storing and reading data from cloud storage like Azure blob storage
Quality Engineer Lead
Optum
08.2015 - 09.2022
- Ensure that products and services meet established quality standards and customer requirements
- Followed Agile methodologies and complete stories within sprint
- Scheduled demo with POs and Business stakeholders
- Design, develop, and maintain test automation frameworks to support automated testing efforts across various applications and platforms
- Analyze automated test results and identify defects, anomalies, and performance issues, providing detailed reports to stakeholders for informed decision-making
- Work closely with development teams to integrate automated testing into the continuous integration and continuous deployment (CI/CD) pipeline, ensuring timely feedback and bug resolution
Testing Engineer
Darien Software Systems
03.2013 - 08.2015
- Worked as a Manual and ETL Tester
- Involved in preparation of Test Plan, Identification of Test Scenarios and Test Cases
- Prepared SQL Queries for Data Validation as part of ETL Testing
- Conducted Functional and System Testing
- Uploaded Test Cases into HP ALM
- Defect tracking in JIRA
Education
B.Tech - EEE
JITS Engineering College
Karimnagar, Telangana05-2011
12th - MPC
Alphores Junior College
Karimnagar, India05-2007
10th -
Vindhya Valley High School
Karimnagar, India05-2005
Skills
Azure Data Factory
Databricks
PySpark
SQL expertise
Python
ETL development
Data pipeline design
Data modeling
Data warehousing
Azure Synapse
Data migration
CI/CD
Personal Information
Date of Birth: 06/02/89
Certification
AZ-900
Timeline
Azure Data Engineer
Optum Global Solutions
10.2022 - Current
Quality Engineer Lead
Optum
08.2015 - 09.2022
Testing Engineer
Darien Software Systems
03.2013 - 08.2015
B.Tech - EEE
JITS Engineering College
12th - MPC
Alphores Junior College
10th -
Vindhya Valley High School