Durisala Sivaparvathi

Aws Data Engineer

Mastek ltd

Andhra Pradesh

01.2021 - Current

Company Overview: Company Project: International Personal Finance (AWS Cloud-Based Data Lake)
Developed and managed well-functioning metadata driven ingestion framework and RestAPI to efficiently and effectively extract, transform and load (ETL) data from various sources into a centralized data lake using AWS Glue, S3, SQL
Built a framework, which created dedup views and spot views in Snowflake, improving data quality and reducing redundancy.
Maintained AWS infrastructure, ensuring optimal performance, cost savings by monitoring and adjusting resource allocation, and leveraging server less computing technologies such as AWS Lambda and EC2.
Implemented AWS security best practices, including IAM roles and policies, to ensure a secure cloud infrastructure.
Built and delivered data-driven KPI (Key Performance Indicators) for various stakeholders to track progress and measure success of data projects.
Collaborated with cross-functional teams to design, implement and optimize REST APIs using AWS API Gateway, Secrets and Lambda.
Managed and optimized data storage and retrieval using S3, RDS PostgreSQL, and Snowflake.
Worked in an agile environment, participated in sprint planning, stand-up meetings, and retrospective sessions, and delivered high-quality code on time.
Company Project: International Personal Finance (AWS Cloud-Based Data Lake)
Domain: The project domain was finance, with a focus on data management and analytics.
TOOLS: AWS Services: AWS Glue (advanced), AWS Lambda (advanced), Amazon S3 (advanced), Amazon Athena(advanced); Data Warehousing Tools: Snowflake (intermediate); Database Technologies: MySQL (intermediate); Programming Languages: Python (advanced); Collaboration Tools: Jira, Confluence.