Anuj Pathak

Supported a 1M USD data management project for a Fortune 500 pharmaceutical client by designing project architecture, automating workflows and supporting data governance implementation

• Automated data extraction from 300+ sources by scripting Python-based extractors integrated with Alteryx scheduling to handle varying frequencies, improving efficiency and ensuring timely data availability
• Built modular ELT pipelines using Spark and DBT to standardize and automate data transformation based on business logic, enabling scalable and repeatable workflows that cut down manual workload
• Optimized data ingestion pipelines by leveraging SnowSQL and Snowpark for efficient execution of DDL/DML queries on large-scale datasets, resulting in a 67 percent increase in ingestion speed
• Translated client-defined KPIs and business questions into automated Tableau reporting solutions, streamlining analysis workflows and cutting down weekly manual effort by over 10 hours.
• Built scalable pipelines ingesting SFTP files into ADLS Gen2 via ADF, transforming data using Azure Databricks, and loading curated outputs into Snowflake to enable advanced analytics.
• Replaced TIBCO matching logic with a custom Python fuzzy matching script, optimizing performance and reducing annual TIBCO server costs by 8 percent

• Migrated 100+ legacy SharePoint Designer workflows to Power Automate.
• Automated 20+ repetitive approval processes using Power Automate, saving an estimated 200+ manual hours per quarter.
• Developed Power Apps solutions, including an internal news feed app, increasing employee engagement and streamlining communication for 1,000+ users.