Summary
Overview
Work History
Education
Skills
Certification
WORK HISTORY
Timeline
Generic

Vivek Pathak

Lead Software Engineer
Lucknow

Summary

As a Lead Software Engineer with over 7 years of experience in the IT industry, including more than 4+ years specializing as an AWS Data Engineer, I excel in designing and implementing data solutions on AWS with proficiency in Python, SQL, and Pyspark, alongside adeptness in BI tools like Amazon Quicksight, Tableau, and Power BI.

Overview

5
5
years of professional experience
4
4
years of post-secondary education
3
3
Certifications
2
2
Languages

Work History

Lead Software Engineer

Virtusa Consulting Services Private Ltd.
10.2024 - Current

Project: Client Data Exchange/JPMorgan Chase & Co.

  • Developed scalable data engineering solutions on AWS using Python and PySpark for various enterprise data needs.
  • Designed and implemented reusable frameworks in AWS Glue for data transformation pipelines supporting structured and semi-structured datasets.
  • Contributed to BvD migration project using Terraform, ensuring secure and scalable infrastructure deployment across environments.
  • Integrated AWS services such as Step Functions, EventBridge, SNS, and Lambda to automate complex event-driven workflows with robust observability via CloudWatch.
  • Contributed to multiple feature upgrades and production enhancements improving overall pipeline efficiency and reliability.

Technology & Tools:

  • AWS Services- Glue, Step Functions, Lambda, S3, Athena, SNS, EventBridge, CloudWatch
  • Infrastructre: Terraform
  • Scripting- Python, Pyspark


Data Engineer

Quantiphi Analytics Solution Private Ltd.
12.2022 - 10.2024

Project: Q2Q (Quick to Quicksight)/Nuvance Health

  • Developed a Python-based solution to automate the generation of inventory, assessment reports and migration of Tableau workbook to Quicksight.
  • Assisted in identifying active and inactive users and assess current Tableau infrastructure costs, determining potential savings through migration to QuickSight.

Technology & Tools:

  • AWS Services- S3, ECS, DynamoDB, CloudWatch, Cloudshell, Amazon Q, Lambda
  • Scripting- Python
  • Business Intelligence- Amazon Quicksight, Tableau Server

Data Engineer

Quantiphi Analytics Solution Private Ltd.
04.2022 - 11.2022

Project: Internal (DQM)

  • Developed a Python-based data quality management solution that integrates data profiling and visualization within a BI.
  • Improved data governance, enhanced data integrity, and protected sensitive PII information.

Technology & Tools:

  • AWS Services- S3, Athena, Glue, Dynamo DB, Lambda
  • Scripting- Python, Pyspark
  • Business Intelligence- Amazon Quicksight

Data Analyst

SagasIT Analytics Private Ltd.
01.2021 - 07.2021

Project: Supply Chain/Hindustan Unilever

  • Worked in the field of data visualization on Power BI in Supply Chain Domain.
  • Reshaped the data as per the business needs using Python.
  • Improved existing BI systems and created visualization and reports for requested projects.

Technology & Tools:

  • Scripting - Python, Excel
  • Business Intelligence - Microsoft Power BI

Data Analyst

SagasIT Analytics Private Ltd.
02.2020 - 12.2020

Project: Inventory Management/LONZA GROUP AG

  • Created an ETL pipeline on Microsoft SSIS for Lonza Group.
  • Designed and developed SSIS packages and stored procedures to streamline the transformation layer of data.
  • Developed end-user reports for data analysis.

Technology & Tools:

  • Microsoft BI Suit- SQL Server, SSIS, Excel
  • Business Intelligence- Microsoft Power BI

Education

Bachelor of Technology (B.Tech) - Electronics & Communication

Ajay Kumar Garg Engineering College
Ghaziabad, India
01.2011 - 01.2015

Skills

Cloud- Terraform, AWS S3, Lambda, Athena, EKS, ECS, EC2, AWS Glue, API-Gateway, Dynamo DB, AWS Kinesis Data Stream, RDS, Cloudshell, CloaudWatch, Aurora(Postgresql/Mysql), Redshift, EMR

Container- Docker

undefined

Certification

Full Stack Data Science With Python and R - Jigsaw Academy.

WORK HISTORY

  • Senior Data Engineer - Quantiphi Analytics Solutions Pvt Ltd. (Feb 2022 – Present)
  • Data Analyst - SagasIT Analytics Pvt. Ltd. (Sep 2019 – Jul 2021)
  • Marketing Analyst - Notandum Brands Pvt. Ltd. (Jun 2017 – Feb 2019)

Timeline

Lead Software Engineer

Virtusa Consulting Services Private Ltd.
10.2024 - Current

Data Engineer

Quantiphi Analytics Solution Private Ltd.
12.2022 - 10.2024

Data Engineer

Quantiphi Analytics Solution Private Ltd.
04.2022 - 11.2022

Data Analyst

SagasIT Analytics Private Ltd.
01.2021 - 07.2021

Data Analyst

SagasIT Analytics Private Ltd.
02.2020 - 12.2020

Bachelor of Technology (B.Tech) - Electronics & Communication

Ajay Kumar Garg Engineering College
01.2011 - 01.2015
Vivek PathakLead Software Engineer