SHUBHAM KUMAR

Project 1: Next Generation Engagement 2.0

• Created Architecture design and High level design to load data from Snowflake to Anzo to Neptune.
• Created design to enable multiple use-case on top of Knowledge Graph.
• Maintained quality of designs through continuous review and hands-on leadership of entire process.
• Developed robust solutions to handle data from multiple brand without change in ontology.

Project 1: Next Generation Engagement (Customer-360)

• Created ontology for almost 20 datasets.
• Developed Anzo pipeline to read data from S3/ Snowflake and convert it to RDF
• Developed additional features on top of graph.
• Developed code to orchestrate data flow from Source to target (Anzo and Neptune) in Databricks.

Project 2: Data Market Place

• Created ontology for complete commercial domain.
• Designed ontology to handle data based on domain using SKOS and OWL.
• Created configuration driven utility to convert CSV/ JSON to RDF.
• Designed automated pipeline to ingest data (bulk or incremental) and convert it into RDF and then load RDF to Stardog/ Neptune for further analysis.
• Created utility to validate graph using SHACL.

Project 1: Andromeda (POC)

• Derived physical model through semantic model
• Created semantic model for transformation rule.

Project 2: RepAI Trigger Engagement

• Lead team from data engineering (DE) side and was point of contact for any data engineering and consulting related ask.
• Designed RDS and APIs for trigger engagement.
• Technology used: pyspark, SparkSql, Airflow, Aurora, API Gateway, AWS Lambda

Project 3: Evaluation of Semantic Search (POC)

• Research on different tools for semantic tool.
• Worked on sample dataset in Stardog, Anzo
• Used Protege to model graph.

Project 1: RepAI Migration to Airflow

• Migration of Databricks code to Airflow.

Project 2: RepAI

• Created complete orchestration on Databricks which will ingest data, create metrics and then pushed final output on RDS.
• Technology used: pyspark, SparkSql, Redshift, Airflow, Databricks.

• As part of L1 support team, was in charge for resolving failed CTRL-M job.