Azure Databricks Data Engineer with hands-on experience building scalable ETL pipelines and data models using PySpark, Spark SQL, and Delta Lake. Databricks Certified Data Engineer Associate, skilled in handling large datasets, implementing SCD Type 1 and 2, optimizing performance, and delivering end-to-end solutions using the Medallion architecture on ADLS Gen2.
Databricks Certified Associate Data Engineer
Subsea Equipment Lifecycle
Built an end-to-end Azure Databricks pipeline using Delta Live Tables (DLT) to track subsea equipment lifecycle, enabling automated ingestion, data quality checks, and Remaining Useful Life (RUL) analytics to support predictive maintenance and BI reporting. Subsea Spare Parts Forecasting | Azure Databricks, Created a scalable data pipeline in Azure Databricks using PySpark and Delta Lake to forecast spare parts demand and compute reorder points. Designed Snowflake schema and implemented SCD Type 1 & 2 to support reliable Power BI reporting and proactive inventory management.
Subsea Spare Parts Forecasting
Created a scalable data pipeline in Azure Databricks using PySpark and Delta Lake to forecast spare parts demand and compute reorder points. Designed Snowflake schema and implemented SCD Type 1 & 2 to support reliable Power BI reporting and proactive inventory management.