Summary
Overview
Work History
Education
Skills
Certification
Accomplishments
Timeline
Generic

Amit Raj

Kolkata

Summary

AWS Data Engineer with 3.5+ years of experience delivering scalable, automated data solutions on AWS. Proven in enhancing ETL pipelines, optimizing Glue workflows, and driving cost-saving automation for drug discovery and analytics. Skilled in Python, AWS (Glue, Lambda, S3, RDS, DynamoDB), Terraform, CloudFormation, and CI/CD. Excels in Agile teams and building cross-account cloud architectures.

Overview

4
4
years of professional experience
1
1
Certification

Work History

AWS Data Engineer

Accenture
Kolkata
07.2021 - Current
  • Worked for over 3.5 years as a Data Engineer with a leading pharma client, enhancing ETL pipelines to support drug discovery data processes, managing over 50 Change Request Handling (CHR) processes annually.
  • Developed cross-account AWS Glue jobs to fetch and consolidate data from Step Functions, Schedulers, and Glue workflows and different aws services—driving automation and enabling dynamic dashboards.
  • Built cross-account Glue pipelines to consolidate job and workflow metadata, supporting dynamic dashboards and monitoring.
  • Created AWS Lambda functions in Python to convert XML to JSON, integrate with API Gateway, and streamline multi-format data ingestion.
  • Designed and optimized ETL pipelines using EDLS tools, improving reliability and performance for reporting and analytics.
  • Designed and maintained scalable infrastructure using AWS CloudFormation and Terraform for resource provisioning.
  • Managed AWS RDS and DynamoDB databases, applying fine-grained IAM controls and securing access using security groups and VPCs.
  • Reduced S3 storage costs by ~$5K/day by developing automated cleanup strategies using Python, AWS Storage Lens, and Athena.
  • Supported Agile development, helping backend teams with stability improvements and feature rollouts, leading to better product functionality.
  • Contributed to GenAI solution development, leading to the creation of GPT-based tools that enhanced automation and insights for client-specific use cases.

Education

B.Tech - Mechanical Engineering

LNCT
Bhopal
06-2021

Skills

  • Cloud Platform: AWS
  • Infrastructure as Code: Terraform, CloudFormation
  • Scripting and Automation: Python, Shell
  • Frameworks: Spark
  • Database: MySQL, DynamoDB
  • CI/CD Tools: Jenkins, CodePipeline
  • Developer Tools: Git, VS Code, Visual Studio, PyCharm, Tableau, GenAI, Linux
  • Libraries: Pandas, NumPy, Matplotlib, Boto3, Openpyxl

Certification

  • AWS Certified Cloud Practitioner - AWS
  • AWS Certified Solutions Architect – AWS
  • GCP Associate Cloud Engineer - Google

Accomplishments

  • Success Catalyst Award
  • The Extra Milestone Award

Timeline

AWS Data Engineer

Accenture
07.2021 - Current

B.Tech - Mechanical Engineering

LNCT
Amit Raj