Pavithra Rajagopal

Project 1: Banking

The project involves migrating logic from a legacy system, where source data resides in Hive tables and is transformed/loaded using Informatica BDM into various Hive target tables. The objective is to transition from this approach by decommissioning Informatica BDM and converting all BDM mappings into Snowflake stored procedures. This project helps client save 20M USD by shutting down Teradata, Hadoop and Informatica BDM.

• Led a team of 6 in converting Informatica BDM mappings to STTM documents.
• Successfully converted 100+ BDM mappings to STTM documents, facilitating the creation of Snowflake stored procedures.
• Collaborated closely with onsite team for continual improvement.
• Contributed to the conversion of HiveQL scripts into Snowflake stored procedures.
• Engaged in Proof of Concepts (POCs) aimed at automating the documentation process.
• Provided continuous support to the team, addressing any doubts they had regarding BDM mappings.
• Triggered Automic workflows to make the stored procedures run on sequential order. Enhanced few Informatica Powercenter mappings.

Project 2: Logistics

Facilitate the registration of each purchase of Ferrari goods with the Government of India GSTIN Portal to ensure compliance. This entails configuring Informatica to extract E-invoices from SAP SFTP folders and securely transmit them to the GSTIN portal using designated APIs. Then GSTIN portal will provide encrypted responses containing the Invoice Reference Number (IRN) and signed QR Code. Informatica will decrypt this information and transmit it back to SAP for further processing.

• Developed a complex IICS CAI process/CDI mapping to read XML files from SAP SFTP folder using File Ingestion tasks and XML to JSON and JSON to XML file conversion in Informatica CAI.
• To authenticate customer ASP with NGO body by sending encrypted data, then to authenticate customer ASP with GSTIN portal of India using POST method in API.
• To send the encrypted SAP JSON payload to GSTIN portal to get encrypted response, then decrypted the response using shell scripting and to send the decrypted JSON file back to SAP SFTP folder.

Project 3: Logistics

The project aims to establish a data warehouse in Snowflake, serving as the foundation for Power BI to generate reports for end users. This data warehouse will source data from various files stored in AWS S3.

• Developed IICS mappings with incremental loading strategies to efficiently load data into AWS S3 buckets.
• Established source and target connections.
• Designed and implemented stored procedures to facilitate the loading of data from the internal stage to raw layer tables in Snowflake.
• Created snow pipe for auto ingestion of files from AWS S3 buckets to snowflake’s internal stage.

This project is to consolidate existing North America, Asia Pacific, Japan SAP systems into a new ‘Global SAP’ system. Business objective is to build a new SAP system using the existing data and all the Batch jobs needs to be made as real time jobs using Application integration/Web services in Informatica. IICS served as main integration tool for this project. This helped client to replace slower RFC calls with realtime API calls.

• Created Requirement definition document (RDD) for which performed impact Analysis to change existing BAPI jobs to real-time API jobs, Architectural design document (ADD) for which created workflow models and created Detail Design Document (DDD) to foster build and enhancement phase.

ETL Development:

• Worked on IICS mappings which will involves API methods like POST and GET.
• XML to Relational Table: Loading 'n' number of XML file to Oracle table using Hierarchy Parser and Hierarchy Schema in Informatica
• IDOC integration with IICS: successfully loaded IDOC files from SAP to Oracle tables using series of mapplets and IICs transformations to make it run in real time and also helped team to implement the same.
• Worked on various source systems like AWS CDP data lake, SAP - BAPI, IDOCS, Files, APIs, Salesforce, Oracle and redshift targets.

Automation:

• Dynamic File Reading for Delimited and Fixed-width files using UNIX command in IICS mappings. This process also involves File archival for every 30 days and handles scenarios when there is a delay in placement of the source file using Structure file.
• Parameterization of Swagger file: Achieved by using Web Service and Business service Transformations.
• Parameterization incremental load for API source: This uses Web Service Transformation, Expression Transformation along with IICs parameters, incorporated Pre data cleansing to meet business standards.

KANAN application deals with consumer and broker data lending loans which used for generating several reports on different schedules. The final reports give the statistics of loan that company lend or sold to consumer or broker. It uses different cloud services to collect or transform the data from source to target servers. Target can be a database/cloud storage.

• This is a data migration project that involves end-to-end process of fetching heterogeneous data from PostgreSQL (source), then the data will be cleasned and transformed as per requirement by creating mappings in IICS and finally the transformed data will be loaded to the target Database (MSSQL).
• Responsible for developing mappings followed by monitoring the jobs in all the environments (DEV, QA, STG, PROD) to ensure that all the jobs are running fine without errors.
• Delivered tasks on time by working closely with teammates.
• End to end data flow checks has been done for every mappings in every sprint.
• Day to Day coordination with clients.
• Suggested and Succeeded with Performance improvement ideology.