PRASHANT TRIPATHI

DATA ENGINEER, Merck, Bangalore

DSU Future state, EMD Sereno

Project

10.2022 - Current

Used Snowflake as a data warehouse, leveraged features like Snowpipe for pulling data from the S3 bucket (external stage), pushed data to the Snowflake table, and made use of concepts like Caching, snowflake partition, Data model, Snowflake share, streams, Snowpipe, SP's ,Data warehouse etc.
Strong SQL skills for querying and performance tuning.
Used Snowpark library for connecting with Snowflake and performed a ETL operations.
For POC, we leveraged Snowflake and DBT as tools for transformation, utilizing concepts like models, seeds, SQL CTEs, materialization and macros.
Knowledge of Airflow and API building using Python.
Used Git, GitHub and Azure DevOps for version control(VCS) and tracking changes.
Exposure to CI/CD pipelines to streamline development and deployment processes.
Carried out POC on snowflake and DBT for EMDSERENO Project.
Used AWS Boto3 library for cost calculation, for those services that are in use.
Have knowledge on AWS services like EC2, Lambda, S3, IAM, ECS and GLUE related to data engineering.
Carried out a POC using IICS on TRDL.
Worked on LS projects using Informatica PowerCenter, where we ingested data from the different ERP systems to Salesforce with transformations.
Participated in the design and implementation of data migration strategies.
Attended multiple in-house trainings at Merck on Snowflake and AWS.
Understanding of cloud platforms AWS.
Created a data pipeline at the Foundry Optimize platform using PySpark.