Summary
Work History
Education
Skills
Projects
ADDITIONAL HIGHLIGHTS
Timeline
Generic

DEVANSH SWAMI

Data Engineer
Vadodara

Summary

I’m a results-driven Data Engineer with practical experience in designing and implementing scalable data pipelines using AWS services like S3, Glue, Redshift, Lambda, and Kinesis. With strong skills in Python, SQL, and data structures, I specialize in building efficient real-time and batch processing systems that power data-driven decision making..

Work History

Data Engineer Intern

F13 Technologies
06.2025 - 08.2025

Real-Time Analytics System for User Activity.

  • Built a real-time event pipeline using Kafka, AWS Lambda, and S3 to process and store user activity data with less than 10 seconds latency.
  • Created Power BI dashboards for tracking engagement metrics and detecting behavioral anomalies in real time.
  • Automated log ingestion, transformation, and partitioning for scalable, fault tolerant analytics.

End-to-End CI/CD Pipeline with Docker and EC2.

  • Developed a Github Actions pipeline for automated build, test, and deployment of a Flask app on AWS EC2.
  • Containerized the application with Docker, ensuring consistent and reproducible deployments.
  • Optimized pipeline runtime by 40% using caching and parallel workflows, with rollback safety for reliability.

Education

Bachelor of Technology - Computer Science

ITM SLS Baroda University
Vadodara, Gujarat
04.2001 -

SSC/HSC -

St. Stephens High School
Dahod, Gujarat
04.2001 -

Skills

programming & Tools: Python, SQL, NumPy, Pandas

Data Technologies: Apache Airflow, Apache Kafka, PySpark, Power BI

Cloud & DevOps: AWS S3, EC2, Lambda, Glue, Redshift, Kinesis Snowflake, Github Actions, Docker, CI/CD Pipelines

Databases: MySQL, AWS DynamoDB

Projects

Automated S3 Backup System using EC2

  • Designed an automated backup solution on EC2 that syncs and archives critical data to S3 using scheduled cron jobs.
  • Implemented versioning and lifecycle policies in S3 to reduce storage cost and maintain recoverable data versions.
  • Integrated SNS notifications for real-time alerts on backup success or failure events.

Airflow-Based Data Pipeline Orchestration

  • Developed modular DAGs in Apache Airflow to automate ETL workflows involving S3, Redshift, and Lambda.
  • Utilized S3KeySensorAsync for event-based triggering and XComs for inter-task data exchange.
  • Monitored and optimized DAG performance, ensuring fault tolerance and retry handling for large-scale jobs.

ADDITIONAL HIGHLIGHTS

  • AWS Certified Data Engineer - Associate (DEA - C01)
  • Continuously upskilling in advanced AWS services and other data engineering tools.

Timeline

Data Engineer Intern

F13 Technologies
06.2025 - 08.2025

Bachelor of Technology - Computer Science

ITM SLS Baroda University
04.2001 -

SSC/HSC -

St. Stephens High School
04.2001 -
DEVANSH SWAMIData Engineer