Hitesh Muthiyan

Project Title: UHG POS

Key Contributions:

• Successfully migrated Perl scripting, DataStage, and Teradata (TD) to Google Cloud Platform (GCP) for a Point of Sale (POS) project.
• Converted legacy logic of data pipelines to GCP-compatible formats, ensuring smooth transition and compatibility.
• Utilized IBM DataStage and Teradata for migration to BigQuery (BQ), optimizing data processing and storage.
• Created Directed Acyclic Graphs (DAGs) for Airflow and pipeline mappings, enhancing workflow automation and monitoring.
• Developed utilities for TD to BQ Data Definition Language (DDL) conversion and reverse, improving data management efficiency.
• Designed and implemented a utility for creating source to target mapping documents, streamlining assessment team inputs and documentation processes.

Key Achievements:

• Ensured seamless migration of legacy systems to GCP, minimizing disruption and downtime.
• Improved data processing efficiency and scalability by leveraging GCP's advanced features.
• Enhanced workflow automation and monitoring through the implementation of Airflow DAGs.
• Facilitated effective communication and collaboration with assessment teams through streamlined documentation processes.

Technical Skills:

• Tools: IBM DataStage, Teradata, Google Cloud Platform (GCP), BigQuery (BQ), Airflow, Pelican
• Languages: Perl, SQL, Big query, Shell, Python
• Utilities: TD to BQ DDL Conversion, Source to Target Mapping Document Creation
• Domain: Healthcare

Project Title:

• IBC - Leading the migration and integration of Teradata and DataStage pipelines into Google Cloud Platform (GCP), optimizing data processing efficiency.

Key Contributions:

• Implemented CI/CD and Airflow for deployment automation, improving efficiency and reliability.
• Created and optimized BQ user-defined functions like "translate" to enhance data processing capabilities.
• Collaborated with teams across the organization, including testing, DevOps, and production, to ensure successful project delivery.
• Conducted unit testing to identify and rectify errors in SQL/shell code, ensuring data quality and system performance.
• Resolving production issues promptly, minimizing downtime and ensuring uninterrupted data flow.
• Collaborating with cross-functional teams to migrate and integrate pipelines, ensuring compatibility and efficiency.
• Implementing best practices and methodologies to optimize data processing and improve overall system performance.
• Providing technical support and guidance to team members, ensuring adherence to project timelines and quality standards.

Technical Skills:

• Tools: Jenkins, DataStage, Teradata, GCP,Putty, WinSCP, Git Bash, Airflow
• Other: Production Support, Parallel Run Fixes, Data Migration, Pipeline Integration
• Domain: Health Care

Project Title:

IBC - TD to BQ (GCP) Data migration.

Key Achievements:

• Designed and implemented ETL processes to load enterprise data into the Data Warehouse, ensuring data integrity and efficiency.
• Utilized IBM InfoSphere DataStage for logic development and migration from on-premises data to GCP.
• Developed migration code and validated scripts and SQL conversions using Raven tool.
• Built data pipelines in IBM DataStage, focusing on Google BigQuery as the target environment.
• Managed complex interfaces with ODBC and SQL Server connectors, ensuring seamless data flow.

Technical Skills:

Tools: Putty, Winscp, IBM, Airflow, GCP, SQL