Highly skilled and results-oriented Senior Data Engineer with over 6 years of experience in designing, implementing, and maintaining robust data infrastructure and pipelines. Proficient in leveraging advanced data engineering tools and technologies to transform complex data into actionable insights. Demonstrates expertise in cloud platforms, and database management. Strong background in data architecture, ETL processes, and performance optimization.
Project 1 -Pull Non Owned Data from Onprem to AWS(Raw Zone)
Technology Used: AWS Glue,Transit Gateway, S3,KMS ,Secrets Manager,AWS Lake Formation,Crawlers
Project 2 -Build the Data products for Advisory Business-SEI(Curation Zone)
Technology Used: S3, Crawlers, Lambda,KMS,AWS Glue,AWS Lake Formation,Step Function
Project 3-Build the Data products for Retirement Business-WSRS(Curation Zone)
Technology Used: S3,AWS Lambda,KMS,Step Function,Crawlers, Lake Formation,SQS ,Crawlers,AWS Lake Formation
Exposure of Business Data to Power BI(Consumption Layer)
Technology Used: EC2, S3, SSM,AWS Lake Formation,Power BI,IAM user,Athena Views and Tables
Client - National Australia Bank
Responsibilities :
Client - Catalina
Responsibilities :
Cloud Infrastructure and Operations- Amazon Web Services
Storage - S3
Databes- RDBMS(postgresql,MYSQL)
Programming Language- Python, SQL
AWS Glue,AWS Athena,Crawlers
Data Transformation-Pyspark
Networking and Security- VPC,KMS
Messaging and Notification services - SQS, SNS
Operating System- Linux , Windows
Infrastructure as code- Cloud Development kit
Performance Tuning & Optimization
Data Pipelines-Building and maintaining ETL pipelines
AWS Lake Formation
AWS Certified Developer – Associate - Amazon Web Services (AWS)
Recognized with "HATS OFF" Award at Mindtree
Recognised with "Cloud Professional " Skill Tag at Infosys
Awarded with "Rising Star Award" at Principal
AWS Certified Solutions Architect – Professional - Amazon Web Services (AWS)
AWS Certified Devops Engineer Professional- Amazon Web Services (AWS)