Dheeraj Sharma

• Project:

AWS–Snowflake Data Ingestion Framework — Created an Airflow DAG to load multi-format fleet and leasing data from AWS S3 into Snowflake, with automated schema detection, validation, and error handling.

• Work in the automotive leasing and fleet management domain, building AWS pipelines to process customer, contract, and vehicle data using Python and PySpark.
• Designed the Airflow DAG to perform end-to-end ingestion: staging data in S3, applying transformations, and loading into Snowflake.
• Incorporated support for multiple file formats (Parquet, CSV, JSON), and schema evolution.
• Added automated quality checks, dashboards, and alerts to ensure accurate and timely reporting.

• Project:

Insurance Claims ETL Enhancement — Handled high-volume insurance claims data pipelines, and ensured accurate and timely data delivery.

• Managed claims data in the insurance sector for reporting, analytics, and compliance.
• Designed ETL workflows in Talend, Python, and PySpark for both AWS and on-premise sources.
• Integrated data from DocumentDB, Oracle, and APIs into Snowflake.
• Built and loaded data marts in Snowflake to support analytics and reporting needs.
• Implemented Change Data Capture (CDC) processes to handle incremental updates efficiently.

• Project:

AS400 Transaction DB Migration to Snowflake — Moved a money transfer transaction database from AS400 to AWS S3, and Snowflake, enabling faster reporting and analytics.

• Worked in the financial services domain on money transfer systems.
• Led migration efforts from AS400 to AWS S3, and Snowflake using Talend.
• Extracted and restructured legacy business logic for scalable ETL jobs.
• Built monitoring tools and logging systems for AS/400 operations.
• Awarded for delivering a successful migration proof of concept.