Sanjay Bedwal
Dehradun
Summary
Senior AWS Data Engineer with 14+ years of experience designing and building scalable data platforms on AWS. Specialized in batch and real-time data pipelines using Spark, Glue, and Kafka, with strong expertise in data lake architecture, distributed processing, and cloud-native solutions.
Overview
15
15
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
LTIMindtree
03.2024 - 03.2026
- Led AWS infrastructure deployment with Python CDK to streamline resource management.
- Built event-driven data pipelines with AWS Step Functions for automated workflows.
- Ensured secure Glue/Redshift data operations in VPC private subnets.
- Designed Redshift Tables/views for optimized analytics and reporting.
- Implemented unit tests with Pytest for PySpark transformations and CDK stacks, enhancing code reliability.
- Provisioned and configured RDS and Redshift environments with secure networking.
- Recommended and automated weekend shutdown of RDS instances in lower environments, saving the client over $8,000 per month.
- Managed source control and CI/CD deployment via GitLab, ensuring consistent delivery and integration.
Senior Data Engineer
Altimetrik
04.2021 - 03.2024
- Built AWS Data Lake pipelines using Airflow and Drone.
- Implemented Lake Formation for enhanced data lake security.
- Optimized Glue jobs for efficient data processing.
- Implemented Lake Formation for enhanced data lake security.
- Maintained data accuracy through validation checks.
- Optimized Glue jobs for efficient data processing.
- Facilitated agile ceremonies and communicated progress updates to stakeholders.
Data Engineer
Technosoftcorp
02.2020 - 10.2020
- Led team of 5 to design and implement AWS Data Lake using Medallion architecture, enhancing data accessibility.
- Developed reusable Terraform modules and implemented CI/CD pipelines via GitHub Actions, streamlining deployment processes.
- Built ingestion and Glue workflows (SCD1/2, full loads) with monitoring setup, ensuring data integrity and availability.
Data Warehousing Specialist
Infosys
07.2015 - 01.2020
- Built and optimized ETL pipelines with Informatica, Hive, and Hadoop to enhance data processing efficiency.
- Developed PDW procedures for loading facts and dimensions.
- Automated deployments and provided production support for pipelines, ensuring smooth operation and timely updates.
Senior Data Warehouse Developer
Cognizant
11.2014 - 06.2015
- Built ETL workflows in Informatica PowerCenter for data extraction, transformation, and loading.
- Optimized SQL queries and procedures, enhancing data processing efficiency.
- Executed data validation and reconciliation, ensuring high data accuracy.
Data Warehouse Developer
Accenture Services Pvt. Ltd.
08.2011 - 11.2014
- Implemented SCD Type 1 and Type 2 for incremental loads.
- Built ETL pipelines from Oracle, SQL Server.
- Developed BTEQ, FastLoad, MultiLoad scripts and design docs.
Education
Master of Computer Application -
Graphic Era University
Dehardun01-2011
Bachelor of Science -
H.N.B.Garhwal University
01-2008
DOEACC ‘O’ level -
01-2006
Skills
- AWS cloud
- S3
- Redshift
- Glue
- Athena
- EMR
- Lake formation
- Lambda Functions
- Step Functions
- SNS
- SQS
- Cloudwatch Rules/Alarm
- Eventbridge
- IAM
- RDS
- Secret manager
- VPC
- Hadoop
- Hive
- Spark
- Sqoop
- Kafka
- Airflow
- Autosys
- Python
- AWS Python CDK
- Terraform
- GitHub Actions
- Gitlab
- UNIX Shell Script
- PowerShell
- SQL Server
- PDW
- Oracle
- Amazon Redshift
Certification
- AWS Certified Solutions Architect – Associate
- AWS Certified Cloud Practitioner
Timeline
Senior Data Engineer
LTIMindtree
03.2024 - 03.2026
Senior Data Engineer
Altimetrik
04.2021 - 03.2024
Data Engineer
Technosoftcorp
02.2020 - 10.2020
Data Warehousing Specialist
Infosys
07.2015 - 01.2020
Senior Data Warehouse Developer
Cognizant
11.2014 - 06.2015
Data Warehouse Developer
Accenture Services Pvt. Ltd.
08.2011 - 11.2014
Master of Computer Application -
Graphic Era University
Bachelor of Science -
H.N.B.Garhwal University