Summary
Overview
Work History
Education
Skills
Timeline
Generic

Vishnu Kumar

Bengaluru

Summary

As a Data Engineer with over 7 years of IT experience, including 5 years in Snowflake SQL development, data migration, and 2 years as an ETL Developer. Designing and optimizing cloud-based data warehousing, and ETL/ELT solutions. Proficient in Snowflake, AWS technology, and Informatica for building scalable data architectures and managing real-time/batch ingestion. Experienced in leading data migration projects and collaborating within Agile teams to ensure efficient project delivery.

Overview

8
8
years of professional experience

Work History

Data Engineer

Project: Metropolis
09.2022 - Current

PDCloudex Pvt Ltd (Feb 2023 – Present). Note: Continued in the same project; PDCloudex is a sister company of Prodevans.

Prodevans Technologies Pvt. Ltd. (Nov 2022 – Jan 2023)

Centroxy Solutions Pvt. Ltd. (Sep 2022 – Oct 2022)

  • Developed Snowflake objects, including tables, views, stages, flat files, functions, pipes, and stored procedures, and maintained data models and schema designs to support scalable data solutions.
  • Automated incremental loads and backups using task-trees during DML events for enhanced compliance.
  • Maintained data models and schema designs to optimize performance and efficiency in data handling.
  • Developed and maintained ETL/ELT pipelines, integrating data from Oracle, AWS S3, and other sources into Snowflake.
  • Designed and optimized advanced stored procedures with dynamic SQL and user-defined functions for flexible ETL processes.
  • Implemented CDC using Snowflake Streams to track incremental changes in source tables, enabling real-time data pipelines, and ensuring efficient downstream processing with minimal latency.

Software Engineer

Wipro Technologies
Bangalore
12.2021 - 08.2022
  • Migrated structured and semi-structured files (CSV, JSON, Parquet) from AWS S3 into Snowflake using IICS pipelines.
  • Designed Snowflake objects, including tables, views, procedures, file formats, and continuous Snowpipe loading.
  • Implemented the COPY INTO command to ingest staged data into target Snowflake tables with the necessary transformations.
  • Used Secure Views and Materialized Views to expose data securely to partner applications.
  • Applied aggregate functions, window functions, joins, and subqueries in complex SQL logic for data transformation.
  • Utilized JIRA to manage sprint cycles in an Agile environment with three-week iterations.

Data Engineer

MAGTORQ ENGINEERING SOLUTIONS PRIVATE LIMITED
09.2017 - 12.2021

Project 1: Investor Online Network Data Migration (Jul 2020 - Dec 2021)

  • Migrated data from the Oracle Database to Snowflake using flat files as part of application modernization and cloud migration initiatives.
  • Designed and implemented Snowpipe to automate data ingestion from AWS S3 into Snowflake, enabling seamless and continuous data integration from Oracle to Snowflake.
  • Handled semi-structured data using Snowflake’s VARIANT datatype, FLATTEN function, and flat files.
  • Executed structured data migration using Snowflake's STAGE and COPY INTO commands.
  • Utilized Snowflake's advanced features, in combination with third-party tools, to design and implement efficient ETL/ELT pipelines, auto data ingestion, transformation, and loading.

Project 2: Solarisbank Data Migration (Sep 2017 - Jun 2020)

  • Optimized queries using SQL features like indexing, partitioning, tracing, and collections.
  • Translated business requirements into SQL queries using analytical functions, joins, and operators.
  • Designed and implemented SQL packages, procedures, functions, triggers, and exception handling to efficiently retrieve, validate, and migrate complex datasets.
  • Utilized AWS Athena for SQL-based testing and analytical validation of transformed datasets, ensuring data accuracy and query performance.
  • Engaged Hadoop ecosystem tools—including HDFS for distributed storage and Hive for structured querying over large-scale data—facilitate seamless data transformation and reporting pipelines.
  • Delivered technical support and strategic guidance on database-related issues while fostering clear communication with team members and stakeholders.

Education

Sona College of Technology -

BE(2012 - 2016)
Salem

Skills

  • Snowflake SQL and objects
  • AWS S3 storage
  • ETL and ELT concepts
  • SQL proficiency
  • Hive and HDFS
  • IICS and DBT tools
  • GitHub
  • Power BI data visualization

Timeline

Data Engineer

Project: Metropolis
09.2022 - Current

Software Engineer

Wipro Technologies
12.2021 - 08.2022

Data Engineer

MAGTORQ ENGINEERING SOLUTIONS PRIVATE LIMITED
09.2017 - 12.2021

Sona College of Technology -

BE(2012 - 2016)
Vishnu Kumar