RanjithKumar Ravikumar
Snowflake Data Engineer
Bangalore
Summary
Accomplished Senior Software Engineer with extensive expertise in Snowflake and AWS, specializing in data migration and pipeline optimization. At CSG International, I successfully implemented an end-to-end Snowflake solution, enhancing data flow efficiency. Proficient in SQL and Snowflake, I excel in collaborative environments, driving innovative data solutions that ensure integrity and performance. Experienced in delivering data solutions across Banking, Finance, Retail, and Telecom domains.
Overview
7
7
years of professional experience
1
1
Certification
Work History
SOFTWARE DEV ENGR SNR
CSG International
02.2023 - Current
- Spearheaded the data migration from Redshift to Snowflake, ensuring minimal disruption and optimized data transfer.
- Engineered the migration process by configuring S3 as an intermediary staging area, then leveraging Snowpipe, Tasks, and Streams to efficiently load data into Snowflake.
- Conducted comprehensive performance tuning on Snowflake, optimizing query execution .
- Developed a robust mart layer within Snowflake, tailored for analytical workloads and business intelligence reporting.
- Designed and implemented an end-to-end Snowflake solution, encompassing ingest, staging, and mart layers to establish an optimized data flow.
- Configured Snowpipe and established integrations to automate real-time data loading from various sources into Snowflake.
- Developed a data pipeline utilizing Snowflake Tasks, Streams, and Stored Procedures to automate data loading and seamlessly integrate with DOMO for visualization.
- Developed custom Stored Procedures in Snowflake to perform complex data transformations and ensure seamless data loading, meeting specific business requirements like data export into SFTP locations.
- Implemented a comprehensive alerting system and metadata framework to monitor data pipeline success and failure events, ensuring proactive issue resolution.
- Created detailed documentation for all implemented solutions and utilized GitLab CI/CD pipelines to automate code deployment to higher environments, ensuring consistent and reliable releases.
- Leveraged a suite of AWS services, including AWS Glue, Lambda, S3, SQS, and DynamoDB, to build scalable and resilient data processing pipelines.
- Implemented Snowflake Data Sharing to provide secure and real-time data access to clients, enhancing collaboration and enabling data-driven decision-making.
- Experienced in agile development methodologies, actively participating in SCRUM ceremonies within sprints to deliver projects efficiently.
DATA ENGINEERING SENIOR ANALYST
Accenture Solutions Private
12.2021 - 02.2023
- Executed data migration projects from Hadoop to Snowflake, ensuring data integrity and performance.
- Developed NiFi ETL jobs to extract data from Hadoop and load it into AWS S3, preparing it for Snowflake ingestion.
- Automated data loading into Snowflake using Snowpipe, Tasks, and Streams, enabling near real-time data availability.
- Implemented Data Vault modeling principles within Snowflake, designing Hubs, Links, and Satellites to support data integration, and utilized DBT to manage and automate data transformations within the Data Vault model.
- Designed and implemented data models in Snowflake to support all stages of the ETL process, ensuring data consistency and accuracy, and leveraged DBT to build and maintain these models.
- Utilized Snowflake's clustering keys and partitioning to optimize query performance and reduce data retrieval times, and optimize data transformations for improved performance.
- Developed and optimized SQL queries within Snowflake for data transformation and analysis, leveraging features like window functions and common table expressions (CTEs), and streamlined SQL-based transformations.
- Employed Snowflake's Time Travel feature for data recovery and historical analysis, ensuring data reliability.
- Automated code deployment to higher environments using GitLab CI/CD pipelines, ensuring consistent and efficient releases.
CONSULTANT
Capgemini Technology Services
09.2018 - 12.2021
- Contributed to the migration of Hadoop data pipelines to Snowflake, supporting performance enhancements.
- Developed data ingestion processes into S3 using AWS Glue and Lambda, preparing data for Snowpipe.
- Participated in large-scale dataset migrations to Snowflake using Snowpipe and custom ETL.
- Automated Snowflake data loading with streams, tasks, and stages, streamlining data workflows.
- Developed and optimized SQL queries for data analysis and validation, focusing on performance.
- Utilized Matillion ETL for data transformation and loading into Snowflake, improving pipeline efficiency.
- Assisted with data integrity checks through comparison scripts between Hadoop and Snowflake.
Education
BACHELOR OF ENGINEERING - COMPUTER SCIENCE ENGINEERING
KONGU ENGINEERING COLLEGE
Erode, India 04.2001 -
Skills
SNOWFLAKE
SQL
DBT
AWS
PYTHON
GIT
APACHE NIFI
HADOOP
REDSHIFT
MATILLION
HADOOP
REDSHIFT
MATILLION
HADOOP
REDSHIFT
Certification
SNOWPRO CORE
Timeline
SOFTWARE DEV ENGR SNR
CSG International
02.2023 - Current
DATA ENGINEERING SENIOR ANALYST
Accenture Solutions Private
12.2021 - 02.2023
CONSULTANT
Capgemini Technology Services
09.2018 - 12.2021
BACHELOR OF ENGINEERING - COMPUTER SCIENCE ENGINEERING
KONGU ENGINEERING COLLEGE
04.2001 -
Similar Profiles
Banu ManoharanBanu Manoharan
Enterprise Business Solutions Architect at CSG InternationalEnterprise Business Solutions Architect at CSG International
Kelly GrayKelly Gray
Training Specialist at CSG InternationalTraining Specialist at CSG International
Achal AgrawalAchal Agrawal
SDE-1 at CSG InternationalSDE-1 at CSG International
Karnabir DattaKarnabir Datta
End-To-End Solution Architect at CSG InternationalEnd-To-End Solution Architect at CSG International
Ameer AhamedAmeer Ahamed
Product Owner at IBM India Pvt LtdProduct Owner at IBM India Pvt Ltd