Summary
Overview
Work History
Education
Skills
Timeline
Generic

Vijay Singh

Data Engineer - II
Gurgaon

Summary

Adept Data Engineer with a proven track record at Amazon, specializing in ETL development, data pipeline design, and AWS Cloud Services. Demonstrated expertise in optimizing data processes, enhancing data accuracy by 100% and mentoring junior team members. Excels in SQL programming and fostering collaborative environments, ensuring stakeholder satisfaction through innovative data solutions.

Overview

5
5
years of professional experience
4
4
years of post-secondary education

Work History

Data Engineer - II

Amazon
Gurugram
08.2022 - Current
  • Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
  • Maintained Payment Reconciliation data pipelines to ensure 100% data availability.
  • Developed generic ETL jobs that process 1-2TB records of transactions daily and generate accounts-based financial report.
  • Implements optimized queries for data analysis that help in identifying the root cause of invoicing data for stakeholders.
  • Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
  • Developed a data visualization dashboard of financial reports for higher stakeholders and accounting teams.
  • Optimized/Tuned existing ETL jobs by performing load testing to ensure 100% resource availability during peak load period (prime or festival days).
  • Designed scalable and maintainable data ingestion generic algorithms and design patterns to support business intelligence initiatives and reporting needs.
  • Performs data migration activities every year, as per cost optimization (20-30%) needs.
  • Implements various active monitoring techniques to notify job failure alerts and their remediation 24/7.
  • Provided technical guidance and mentorship to junior team members, fostering a collaborative learning environment within the organization.

Programmer Analyst

Amazon
Hyderabad
08.2021 - 08.2022
  • Works closely with stakeholders to understand business needs and translate them into technical requirements that can be integrated with existing software systems.
  • Contributed to successful project completion with effective time management and prioritization skills, meeting tight deadlines consistently.
  • Performed various bug fixes in existing code to ensure quality and 100% data accuracy.
  • Developed new features and testing process in existing code systems.
  • Established reconciliation processes for 1-2TB of daily transactions flowing in organization.

AWS Cloud Support Engineer

Amazon Web Services
Bengaluru
10.2019 - 08.2021
  • Designed scalable, secured AWS cloud infrastructure and custom scripts that met customer requirements.
  • Supported AWS customers during high severity service issues, troubleshooting.
  • AWS Services: IAM, KMS, ACM, Organization, Secret Manager, EMR, GLUE, S3, DynamoDB, RedShift, CloudWatch, CloudTrail, Config, and others.

Education

Post Graduation - Internet of Things

CDAC-Acts
Pune
08.2018 - 04.2019

Bachelor of Technology - Instrumentation

A.P.J Technical University
UP, India
08.2014 - 04.2018

Skills

ETL development

Data Pipeline Design

Data Modeling

Data Warehousing

SQL Expertise

Performance Tuning

Spark Framework

NoSQL Databases

SQL Programming

Data Analysis

Database Design

Python

Scala

Type-Script

Data Visualization

AWS Cloud Services

AWS Deployments using Boto3 and AWS-CDK

Linux

Git, Intelli-J, VS-Code

Timeline

Data Engineer - II

Amazon
08.2022 - Current

Programmer Analyst

Amazon
08.2021 - 08.2022

AWS Cloud Support Engineer

Amazon Web Services
10.2019 - 08.2021

Post Graduation - Internet of Things

CDAC-Acts
08.2018 - 04.2019

Bachelor of Technology - Instrumentation

A.P.J Technical University
08.2014 - 04.2018

Similar Profiles

CREATE PROFILE
Vijay SinghData Engineer - II