Nidhi

The scope of this project was to perform Data profiling and then migrate the data from different platforms to AWS cloud .

• Extract, Transform and Load data from multiple sources and multiple formats using Big Data Technologies.
• Work across teams to integrate data from multiple Business Areas in a Centralized Data Repository.
• Perform general application development activities, including unit testing, code deployment to development environment and technical documentation.
• Lead effort for Sprint deliverables, and solve problems with medium complexity.
• Mentor analysts and junior level resources in best practices and guidelines for implementations and data analysis; aid in development of learning activities
• CICD Tools: Bitbucket, JIRA, Jules(Jenkins), AIM

Big Data Hub EDW Ingestion

The scope of this project was to build Enterprise Data Warehouse(EDW) Enterprise Stage and BDW layer on Hadoop platform and ingest EDW data from Teradata to BDH in real time Production.

• Create or modify hive scripts and table properties file as part of the
  development process.
• Responsible for automation of various redundant manual processes
• Maintained every version of code in Git by creating feature and release
  branches and merging with master.

Big Data Hub Protegrity Framework

This project expanded PNC’s data protection arsenal by addition of tokenization to the
existing sensitive data which restricted the access to PII data, eventually reduced the
risk of sensitive data loss.

• For this tokenization process a framework needed to be developed along with
  hive, spark and impala custom UDFs to support use of protegrity native
  functions in the framework.
• Concentrated on maximizing application performance and also ensuring
  system-wide efficiency, reliability and compatibility with other platforms.

• Researched the problem of Multiword Expressions and its identification and
  extraction using Python.
• Developed a tool that could be used to analyze Multiword Expressions for
  English-Hindi Translation with to improve accuracy.