Experienced technologist with 7 years of expertise in ETL, BigQuery, and Pyspark. Proven track record in successfully migrating Informatica Powercenter jobs to AWS Glue and GCP BigQuery. Skilled in writing Regex logics for identifying PII information and translating classification requirements into rules. Accomplished in refining classification rules based on test results. Worked as a Big Data Specialist for Ingestion Phase using AllSight and also served as a QA analyst for product releases.
AWS Glue:
Led the migration of Informatica Powercenter jobs to AWS Glue jobs using Pyspark
GCP BigQuery:
Successfully migrated Informatica Powercenter jobs to GCP utilizing BigQuery.
Responsible for task execution in Apache Airflow. Used Airflow for the orchestration of the pipelines
ETL:
Served as an Enterprise Integration Specialist for production support using Informatica Powercenter and Datastage.
BIG ID:
Developed Regex logics to identify PII information.
Translated classification requirements into rules and fetched required data sets using Regex.
Refined classification rules based on test results.
Informatica Customer 360 Insights 3 (formerly AllSight):
Worked as a Big Data Specialist for the Ingestion Phase of customer data using AllSight.
QA analyst for AllSight product releases.
77A, Surya Avenue, 3rd Street, Chennai, Tamil Nadu, 600044