Cloud Data Engineer at Western Union, having 2 years of overall experience.
Knowledge of Matillion ELT, Hadoop, Snowflake etc. specialized in data analysis, data transformation and data validation.
Experience in scaled agile environment.
Knowledge of Writing Complex SQL and using Python, Shell Scripting for orchestrating the overall workflow.
Knowledge of Writing User defined function(UDF) using java in snowflake.
Overview
2
2
years of professional experience
10
10
years of post-secondary education
3
3
Languages
Work History
DATA ENGINEER
Western Union
Pune, Maharashtra
01.2020 - Current
Responsible for carrying out migration activities of reporting solutions from on-premise and legacy technologies to Snowflake and AWS.
Built serverless application using AWS LAMBDA which helps to process request through API And generates dynamic query as per request using Python script it connects snowflake for fetching data provides data as response.
Designed and developed automated data pipelines to extract, transform and load data between data sources when working with large data sets through Matillion.
The Compliance Analytics Platform project mainly provides end to end automated data pipelines for the migration of their on-premises data on Snowflake platform for DataMart formation, the major purpose is taking transaction data and performing operation using Matillion to generate various types of report for business users.
Designed the ETL’s and developed the automated pipeline using Matillion, Snowflake, python and Shell scripting, Amazon S3 and many more AWS cloud services.
Performed migration of NoSQL Data from Couchbase to Snowflake warehouse using Matillion.
Developed various sqoop scripts for performing job automation.