Dedicated and results-oriented professional with over a decade of experience in SQL, Azure Data Factory (ADF), ETL, and data migration. Proven track record of successfully designing, implementing, and managing complex data solutions to meet business objectives. Skilled in optimizing data processes, enhancing data quality, and driving efficiency through automation. Adept at collaborating with cross-functional teams to deliver scalable and reliable data solutions.
• Worked on extracting data from the multiple sources like Salesforce, CSV Files, Excel Files, SharePoint location, Rest API, On Premise SQL Server into Data Warehouse and other sources.
• Responsible for creating multiple Pipelines that serves the above purpose and to load data into the data warehouse.
• Monitored the running pipelines on the daily basis and troubleshoot the errors if any pipeline fails.
• Load data into the parquet files from the multiple objects of the salesforce and done the various transformations like Filter, Union, Conditional Split, Derived Column , Join, etc on to the source data and then loaded into the Final destination table.
• Created few logic apps to load data from the email attachment and from the sharepoint files.
• Modified the existing stored procedures for better performance and reducing the execution time of the stored procedure.
• Done the interactions with the business on requirement gatherings.
• Responsible for analyzing the Design Document and prepare Scope queries for creation of segmentation for Campaigns.
• Create Azure Data Lake Analytics U-SQL like queries to retrieve data from the various streams/cosmos views.
• Used Azure Data Lake Storage Gen1 to store the data retrieve through the U-SQL Script jobs.
• Having experience in Data Migration from on premise SQL Server to Azure SQL and Blob storage and vise versa using Azure Data Factory and DMA.
• Used Azure Synapse Analysis serverless SQL Pool to do further data analysis on Campaign Marketing data.
• Responsible for data cleansing and data validation of source data prior to perform data migration tasks.
• Implementing data migration from SQL Server to Salesforce using SSIS Tool and Salesforce Integration toolkit with SSIS Data Tools.
• Responsible for designing ETL data flows using SSIS; creating mappings/workflows to extract data from SQL Server and Data Migration and Transformation using SQL Server and SSIS.
• Responsible to Database Backup and Restore of staging and source data.
• Actively participate in weekly client status call and providing daily status emails to clients.
• Responsible for analyzing and study client application and database and retrieve required data from the same to develop new system which is product based.
• Having experience in Writing, Analyzing Stored Procedures, Exception Handling, Constraints, Views, and Complex queries for business requirements.
• Proven experience in data migrations with high volumes and in business-critical systems in Insurance Domain.
• Have done the migration using the approach of scripts based Data Migration.
• Data Migration of Co-operative banks that used Desktop based Applications.
• Capability to analyse the shape & health of source data. Extraction of data from multiple legacy sources.
• Have done the migration using the approach of scripts based Data Migration.
• Used the In-House ETL Tool with HORA for Oracle Development for Data Migration.