· A backend developer with 7+ years of experience as a data engineer using MSBI stack and Azure.
· Currently working for Microsoft India as Consultant.
· Analyze PaRTS system and design an approach to hydrate the data lake frequently
· Develop Azure Data Factory (ADF) pipelines, data flows to move data from PaRTS to Azure Data Lake and configure gateways as needed
· Identify the tables/entities that need to be copied to Azure.
· Deploy and schedule the pipelines. Pipelines are planned to be scheduled daily.
· Azure SQL DB/Data Lake as sink/target of the captured data (structured and unstructured) from JBCT workflow
· Create views in azure synapse to be consumed by Power BI report
· Developed census reports using Power BI.
Developed Power BI reports using the captured JBCT data
· Writing stored procedures to load data
· Created Source to destination column mapping documents
· Performance Optimization of SSIS Packages.
· Create pipelines to extract data from On-premises to SQL Azure
· Unit testing, peer review, bug fixing, testing and data validation.
· Creating jobs for scheduling SSIS packages using SQL Server Agent
· Developing reports using Power BI.
· Design, Develop ETL using SSIS to pull data from different sources like on-premises servers and COSMOS.
· Writing “Scope” script to retrieve data from Cosmos file streams and
to extract columns from JSON data.
· Altering the SQL scripts, modify the SSIS Packages and SSRS Report’s logics
Based on change requests raised by User(s) or Client(s).
· Performance Optimization of SSIS Packages.
· Unit testing, peer review and bug fixing.
· Creating jobs for scheduling SSIS packages using SQL Server Agent
· Responsible for History Loads & Monitoring data load.
· Worked with Operations team to deploy the packages to UAT and Production environment.
SQL