Experienced Data Engineer with over 18 months of expertise in technologies such as Python, SQL, and Snowflake. Currently leading data migration projects on AWS, focusing on architecting and implementing efficient ETL pipelines to empower data-driven insights. Committed to staying at the forefront of data technology to deliver impactful results and drive innovation in the field.
Overview
1
1
year of professional experience
4
4
years of post-secondary education
2
2
Certifications
Work History
Data Engineer
Inferenz Tech Pvt Ltd
5 2023 - 2 2024
Attended Sprint planning and daily stand-up meetings to understand requirements and refine sprints
Extracted data from API sources and loaded it into SNOWFLAKE
Created databases, schemas, stages, file formats, and tables in AWS-based SNOWFLAKE using TERRAFORM
Developed stored procedures, views, and secured views
Loaded data into SNOWFLAKE through AIRFLOW
Converted semi-structured JSON data to standard SQL format for readability
Established history and current tables in SNOWFLAKE for API data loading, maintaining raw data in the history table and unpacking JSON columns in the current table
Addressed data quality issues including null values, duplicates, and validation using Postman API
Developed dimension and fact tables in the business layer, transitioning data to the report layer for reporting purposes
Collaborated with the ETL development team to propose and implement improved approaches based on business requirements.
Data Engineer
KASMO TECHNOLOGY PRIVATE LIMITED
07.2022 - 04.2023
Project Description: Guide wire Insurance Suite - focused on loading source data from guide wire on-prem DB to Snowflake cloud, then curating data sets and performing required transformations to generate metrics
Responsibilities: Participated in Sprint planning and daily stand-up meetings
Managed the full project lifecycle from analysis to maintenance using SDLC and Agile
Developed pipelines using ADF to load data from source to target
Loaded data from SQL-Server OLAP to Snowflake
Designed pipelines with complex transformations
Developed SCD Type1 and Type2 pipelines to manage CDC and historical data
Involved in database modeling, creating tables, and defining roles
Experienced in bulk loading data into tables using Copy Into command
Conducted integration testing to ensure pipeline functioning.
Education
Bachelor of Technology in Electrical & Electronics Engineering -
HI TECH COLLEGE OF ENGINEERING
08.2013 - 05.2017
Skills
Leadershipundefined
Certification
SNOWPRO CORE CERTIFIED
Languages
Hindi (Native)
English
Timeline
Data Engineer
KASMO TECHNOLOGY PRIVATE LIMITED
07.2022 - 04.2023
Bachelor of Technology in Electrical & Electronics Engineering -
HI TECH COLLEGE OF ENGINEERING
08.2013 - 05.2017
Data Engineer
Inferenz Tech Pvt Ltd
5 2023 - 2 2024
Similar Profiles
Pankti FadiaPankti Fadia
Data Engineer at Inferenz Tech Pvt LtdData Engineer at Inferenz Tech Pvt Ltd
Senior Technical Support Engineer at Softenger India Pvt Ltd, TECH CENTER ,PROJECT :- HPE MSIP UIDAI TECH CENTER, BangaloreSenior Technical Support Engineer at Softenger India Pvt Ltd, TECH CENTER ,PROJECT :- HPE MSIP UIDAI TECH CENTER, Bangalore