As a Data Engineer with extensive experience in a product-based fintech startup, I am well-versed in data preprocessing, data analysis, and maintaining robust data pipelines. I have a proven track record of optimizing data workflows and reporting, leveraging my skills to enhance data accuracy and drive actionable insights. My hands-on experience in a dynamic fintech environment has honed my ability to manage and analyze large datasets efficiently, contributing to the overall success and innovation of the product.
Overview
4
4
years of professional experience
Work History
Data Engineer
Axis Mutual Fund
Mumbai
10.2023 - Current
Migrated Projects to AWS Cloud: Successfully transitioned projects from on-premises infrastructure to AWS Cloud.
Designed and Implemented Data Pipelines: Created data pipelines to meet stakeholder requirements.
Utilized Airflow for Orchestration: Employed Airflow to manage and orchestrate data workflows.
Applied PySpark for Cloud Compatibility: Used PySpark to ensure code compatibility with cloud platforms.
Worked with AWS Services: Leveraged AWS EMR and S3 for data processing and storage.
Hands-On Experience with On-Prem Tools: Utilized on-premises tools such as SSIS and Oracle effectively.
Managed Ad-Hoc Data Tasks: Provided data handling and reporting to business users using SQL as needed.
DATA ENGINEER
GO DIGITAL TECHNOLOGY CONSULTANCY (Serving Notice Period)
Mumbai
03.2022 - 09.2023
Worked on Electrical Domain Projects:Contributed to projects such as Enterprise Distribution System Health and Carbon Calculation.Focused on domain-specific data requirements and solutions.
Modified and Scheduled ETLs:Updated and optimized ETL processes to enhance performance.Created and managed cron schedules for automated ETL execution.
Infrastructure as Code with Terraform:Built and managed infrastructure using Terraform to ensure scalable and repeatable deployments.
Programming Languages Utilized:SQL: Executed complex queries for data manipulation and reporting. Python: Developed scripts and applications for various data engineering tasks. PySpark: Used for distributed data processing and analysis.
Orchestrated Jobs:Managed and orchestrated data processing jobs and workflows effectively.
Migrated Projects to AWS:Led the migration of projects from on-premises infrastructure to AWS Cloud.
Ensured a smooth transition with minimal disruption and optimized cloud performance.
Focused on AWS Cloud Platform:Maintained primary attention on AWS, leveraging its tools and services to build and maintain cloud-based solutions.
Oversaw Senior-Level Project:Supervised the Carbon Calculation project, leading the team and ensuring the successful delivery of project goals.
Consistently used the same technology stack throughout the project.
Event Manager
SELF-EMPLOYED
MUMBAI
01.2021 - 01.2022
I was working as an Event-manager for multiple 1-5 days promotional , wedding and corporate events
Education
Data Science -
Imarticus Learning
01.2021
B.S.C - IT
MSG-SGKM College
01.2020
H.S.C - Computer Science
S.M Shetty College
01.2016
S.S.C -
D.J Doshi Gurukul Eng Med High School
01.2014
Skills
Coding Languages :-Sql, Python(oops ,pandas , numpy , machine learning libraries), Pyspark , C , Terraform