

Accomplished data engineering professional with expertise in Azure technologies. Focused on optimizing costs and improving project delivery through innovative data solutions, ready to drive impactful outcomes in fast-paced environments.
• Microsoft Azure , Azure Databricks, Azure Data Factory, Lakehouse Architecture, Pyspark
• Created multiple pipelines on Azure data factory & Azure Synapse.
• Worked on a project for Yarra Valley Waterworks client which is a strategic DataLake implementation project for the Government water supply in Victoria state (Australia). The client engaged Amdocs to rationalize its data infrastructure, create a unified reporting platform on the cloud and implement advanced analytics Use Cases on the Azure.
• Creation of Initial Load pipelines for bringing the data from various sources like Oracle Db , SQL Server into the ADLS Gen2 following the best practices.
• Creation of Daily delta load pipelines which is using the CDC generated data as source and writing into the ADLS Gen 2 as parquet files.
• Used the Delta Live Framework which read the parquet/CSV files and Inserted/Upserted the data into bronze layer tables.
• Built a Metadata driven architecture which is being used across the Data Ingestion and the transformation Layer.
• Enriching/Transforming the data further into the fact and dimension tables using the Azure DataBricks (Pyspark)
• Created pipeline which loaded the enriched data into the Datawarehouse (Azure Synapse -Dedicated SQL pool - which acted as the serving layer) and further triggered the Power BI dataset refreshes.
• Created Reconciliation Dashboard using Azure Databricks Dashboards.
• Used Azure Autoloader for NRT processing of Data for a source.
• Created pipeline to turn on & off the Dedicated SQL pool at a particular time.
• Discussions with Internal and External Stakeholders.
• Worked on fixing of issues which were reported by business in already productionized code.
• Worked as a Senior Analyst in Core Banking and Shared Services team for RBS but, played a stretch role of a Lead for 2 years. I was leading a mixed team of RBS and Vendor resources.
• Worked on Core Modernization project.
• Strong Knowledge of Core Banking and Debit Cards domain.
• Worked on Azure Databricks and Azure Data Factory.