- Company Overview: IQVIA formerly Quintiles and IMS Health, Inc is a leading global provider of advanced human data science and analytics, technology solutions, and clinical research services to the life sciences industry.
- NOVARTIS is a Swiss multinational pharmaceutical corporation and one of the largest pharmaceutical companies in the world based in Basel, Switzerland.
- Novartis Brazil is going through a Data and Analytics transformation journey and aiming to leverage the IMI data product.
Roles and Responsibilities:
- Creating Data Ingestion jobs to load the data from Snowflake share/AWS S3 to STAGING & Data Quality Checks for DI & INT jobs in Glass box (IMDNA portal).
- Updating Data Catalogue & Lineage in Glass box DEV & QA environments.
- Creating BRMS process for DI jobs in Glass box.
- Creating Matillion ETL Integration jobs for DI jobs as SCD1 workflow to load the data from STAGING to INTEGRATION, validation & running the job.
- Creating Matillion Data warehouse jobs for INT jobs as SCD2 workflow to load the data from INTEGRATION to DATAWAREHOUSE, validation & running the job.
- Creating Unit Test Case Evidence for data loaded in STAGING, INTEGRATION & DATAWAREHOUSE layers.
- Working on change request, as per requirements like inserting new columns in tables, adding new primary key, and modifying the workflow in Matillion ETL Tool and updating/deleting jobs in Airflow DAG.
- Creating batch files in Json to Import & Generate DAG and Trigger the DAG in Airflow.
- Exporting Json scripts in Matillion and Airflow to deploy in QA and PROD environments.