Bhagyasri Renuka Devarasetty
Guntur
Summary
Results-driven AWS Data Engineer and Tester with a proven track record at Capgemini, specializing in the migration of large SQL Server tables to S3 using AWS services and Python. Demonstrated expertise in Agile methodologies and advanced problem-solving skills has led to significant enhancements in data integrity and accessibility. Committed to leading cloud-based data migration projects that drive innovation and improve project outcomes.
Overview
3
3
years of professional experience
1
1
Certification
Work History
AWS Data Engineer, Tester
Capgemini
Hyderabad
06.2022 - Current
- Batch Tables Data Migration.
- Airflow DAG, EMR, and Glue-based tool to migrate large tables from SQL Servers to S3.
- Used Glue Crawler to create table schema in the Glue Data Catalog.
- All table configurations are stored in a DynamoDB table.
- The Dags will sync the source server data to the S3 target.
- S3 will store the data in Parquet file format.
- Dag logs and dynamo logs are used to monitor the errors and failures.
- Used AWS Athena to perform data comparison and data quality checks between the source and target.
- Tools & Services: Airflow, PySpark, SQL Server, AWS S3, Athena, EMR, Glue, DynamoDB, EC2, VPC.
Education
B. Tech - Electronics and communications
ST. Mary's Women's College of Engineering and Technology
Guntur, Andhra Pradesh01.2021
Skills
- AWS services
- Python
- Cloud and Microservices
- SQL
- Agile methodology
- S3
- Lambda
- DynamoDB
- Athena
- Cloud formation
- I am
- VPC
- Event bridge rule
- Airflow
- Glue
- SNS
- SQS
- Cloud watch
- Data migration applications
- Deploying applications
- Optimization
- Troubleshooting
- Debugging
Certification
- SQL Certified Golden Badge, Hacker Rank
- AWS Cloud Practitioner, 4590071afc2c4a43be2cd727480f3fd4
- AWS Developer Associate, 97RW2PCC0E41QCKC
Timeline
AWS Data Engineer, Tester
Capgemini
06.2022 - Current
B. Tech - Electronics and communications
ST. Mary's Women's College of Engineering and Technology
Similar Profiles
Abdoul-rahim DombaAbdoul-rahim Domba
Ingénieur d'études et de recherche at CapgeminiIngénieur d'études et de recherche at Capgemini
Bélinda BONACINABélinda BONACINA
Document Management, quality and configuration at CAPGEMINIDocument Management, quality and configuration at CAPGEMINI
Namrata DwivediNamrata Dwivedi
Front End Developer at CapgeminiFront End Developer at Capgemini