Akshay Kadam
Hyderabad,Telangana
Summary
Data Engineer with 2 years of experience designing and supporting production-grade data processing platforms on AWS. Hands-on in building CSV-to-Parquet ETL pipelines using PySpark on EC2 and AWS Glue, integrating data from SFTP, APIs, and on-prem systems. Experienced in cloud-native orchestration with Step Functions and Lambda, managing Iceberg tables and RDS, and ensuring data reliability through monitoring, alerting, and SLA ownership. Strong background in Terraform-based infrastructure automation and cost-efficient, scalable data workflows.
Overview
3
3
years of professional experience
Work History
Associate Engineer - T1
HTC Global Services
Hyderabad, India
11.2023 - Current
- Enhanced and maintained large-scale data processing applications using AWS, Terraform, and PySpark to deliver clean and reliable datasets.
- Built and automated daily data conversion flows using AWS Glue and ETL frameworks, improving data quality and pipeline reliability.
- Maintained and monitored daily big data processing jobs, ensuring smooth data conversion and timely delivery to users.
- Performed RDS version upgrades and migrated standalone instances to cluster-based architectures with cross-region replicas for disaster recovery.
- Automated environment provisioning and monitoring using Terraform, EC2 scripting, and CloudWatch, reducing manual tasks and improving efficiency.
- Implemented robust monitoring and alerting through Amazon CloudWatch and AWS SNS to ensure pipeline reliability and early anomaly detection.
Trainee
Snoodify
Remote, India
08.2023 - 11.2023
- Gained practical experience in backend development for Shopify applications using Spring Boot and Java technologies.
- Contributed to designing and implementing backend functionalities to enhance application performance and data handling.
- Worked extensively with Amazon Product Advertising API (PAPI) for data integration, performed web scraping to collect relevant product information, and executed data migration processes to streamline application data usage.
Associate Trainee
Revature
Maharashtra, India
12.2022 - 04.2023
- Gained comprehensive hands-on experience in Java Full Stack Development through an intensive training program.
- Successfully built and deployed a fully functional capstone project on AWS Cloud.
Education
Bachelor of Technology - undefined
Dr. Babasaheb Ambedkar Technological University
01.2022
Skills
- Python
- AWS Cloud: S3, EC2, Glue (ETL, Crawlers, Catalogs), RDS, Lambda, API Gateway, DynamoDB, CloudWatch, Route 53, IAM, SNS, SQS, SFTP, and more
- Version control and CI/CD: Git, GitLab CI/CD, and AWS CI/CD (AWS CodeCommit, CodeBuild, CodeDeploy, and CodePipeline)
- Database: SQL Server, MySQL, and RDS (Aurora PostgreSQL, Aurora MySQL)
- Data engineering and analytics: Apache Spark, PySpark, Pandas, big data processing, ETL pipelines, etc
- Infrastructure as code (IaC): Terraform and Tofu
- Data build tool (DBT), Snowflake, Apache Iceberg
- Apache Airflow
- Gen AI
Languages
English
Hindi
Marathi
Skills
Python
Version control and CI/CD
Git, GitLab CI/
CD, and AWS CI/
CD (AWS CodeCommit, CodeBuild, CodeDeploy, and CodePipeline)
Data engineering and analytics
Apache Spark, PySpark, Pandas, Big data processing, Data conversion, ETL pipelines, Data migration, etc.
Data Build Tool (DBT), Snowflake, Apache Iceberg.
Gen AI
Git Copilot (Claude Sonnet, GPT)
AWS Cloud
S3, EC2, Glue (ETL, Crawlers, Catalogs), RDS, Lambda, API Gateway, DynamoDB, Athena, CloudWatch, Route 53, IAM, SNS, SQS, AWS Transfer Family (SFTP), Step functions and more
Database
SQL Server, MySQL, and RDS (Aurora PostgreSQL, Aurora MySQL)
Infrastructure as code (IaC)
Terraform and Tofu
Apache Airflow
Personal Information
- Title: Associate Engineer - T1
- Nationality: Indian
Hobbies and Interests
- Reading
- Fishing
- Internet surfing
Timeline
Associate Engineer - T1
HTC Global Services
11.2023 - Current
Trainee
Snoodify
08.2023 - 11.2023
Associate Trainee
Revature
12.2022 - 04.2023
Bachelor of Technology - undefined
Dr. Babasaheb Ambedkar Technological University