As a Data Engineer with over 7 years of IT experience, including 5 years in Snowflake SQL development, data migration, and 2 years as an ETL Developer. Designing and optimizing cloud-based data warehousing, and ETL/ELT solutions. Proficient in Snowflake, AWS technology, and Informatica for building scalable data architectures and managing real-time/batch ingestion. Experienced in leading data migration projects and collaborating within Agile teams to ensure efficient project delivery.
Overview
8
8
years of professional experience
Work History
Data Engineer
Project: Metropolis
09.2022 - Current
PDCloudex Pvt Ltd (Feb 2023 – Present). Note: Continued in the same project; PDCloudex is a sister company of Prodevans.
Prodevans Technologies Pvt. Ltd. (Nov 2022 – Jan 2023)
Centroxy Solutions Pvt. Ltd. (Sep 2022 – Oct 2022)
Developed Snowflake objects, including tables, views, stages, flat files, functions, pipes, and stored procedures, and maintained data models and schema designs to support scalable data solutions.
Automated incremental loads and backups using task-trees during DML events for enhanced compliance.
Maintained data models and schema designs to optimize performance and efficiency in data handling.
Developed and maintained ETL/ELT pipelines, integrating data from Oracle, AWS S3, and other sources into Snowflake.
Designed and optimized advanced stored procedures with dynamic SQL and user-defined functions for flexible ETL processes.
Implemented CDC using Snowflake Streams to track incremental changes in source tables, enabling real-time data pipelines, and ensuring efficient downstream processing with minimal latency.
Software Engineer
Wipro Technologies
Bangalore
12.2021 - 08.2022
Migrated structured and semi-structured files (CSV, JSON, Parquet) from AWS S3 into Snowflake using IICS pipelines.
Designed Snowflake objects, including tables, views, procedures, file formats, and continuous Snowpipe loading.
Implemented the COPY INTO command to ingest staged data into target Snowflake tables with the necessary transformations.
Used Secure Views and Materialized Views to expose data securely to partner applications.
Applied aggregate functions, window functions, joins, and subqueries in complex SQL logic for data transformation.
Utilized JIRA to manage sprint cycles in an Agile environment with three-week iterations.
Data Engineer
MAGTORQ ENGINEERING SOLUTIONS PRIVATE LIMITED
09.2017 - 12.2021
Project 1: Investor Online Network Data Migration (Jul 2020 - Dec 2021)
Migrated data from the Oracle Database to Snowflake using flat files as part of application modernization and cloud migration initiatives.
Designed and implemented Snowpipe to automate data ingestion from AWS S3 into Snowflake, enabling seamless and continuous data integration from Oracle to Snowflake.
Handled semi-structured data using Snowflake’s VARIANT datatype, FLATTEN function, and flat files.
Executed structured data migration using Snowflake's STAGE and COPY INTO commands.
Utilized Snowflake's advanced features, in combination with third-party tools, to design and implement efficient ETL/ELT pipelines, auto data ingestion, transformation, and loading.
Project 2: Solarisbank Data Migration (Sep 2017 - Jun 2020)
Optimized queries using SQL features like indexing, partitioning, tracing, and collections.
Translated business requirements into SQL queries using analytical functions, joins, and operators.
Designed and implemented SQL packages, procedures, functions, triggers, and exception handling to efficiently retrieve, validate, and migrate complex datasets.
Utilized AWS Athena for SQL-based testing and analytical validation of transformed datasets, ensuring data accuracy and query performance.
Engaged Hadoop ecosystem tools—including HDFS for distributed storage and Hive for structured querying over large-scale data—facilitate seamless data transformation and reporting pipelines.
Delivered technical support and strategic guidance on database-related issues while fostering clear communication with team members and stakeholders.