ASHISH SINHA

Azure Databricks and Data Factory:

• Developed Azure Databricks generic scripts to read and load data from SFTP server to Azure Synapse.
• Developed Azure Data Factory mappings to load data from raw table to fact table which involves SCD type 2 logic
• Created custom data checks pipelines and also created script to send mail notifications.

AWS Textract and Elastic Beanstalk

• Created python scripts that reads pdf files from SharePoint and loads them to S3 bucket.
• Created python script that scans pdf from S3 bucket and converts it into text data which is loaded into Amazon Aurora.
• Created Dash webpage and hosted in Elastic Beanstalk that allows users to search for keywords in MySQL Database

• Integrated multiple APIs with Azure Databricks to push data to Synapse
• Built, maintained, scaled, and supported 100+ data pipelines using Azure Data Factory and Databricks
• Worked closely with safety team to move clinical data from different vendors stored in AWS to study folders in SharePoint
• Created templates to read and process data from Smartsheet to synapse using Databricks
• Created templates to read and process data from any CSV files stored in container to synapse using Databricks
• Ensured proper storing of both raw and processed data
• Mentored junior developers on team on Azure, and documentation best practices within organization
• Created re-usable UiPath custom activities to upload any file in server to containers, trigger and monitor data factory runs using Azure Python SDK
• Contributed to in-house UiPath library to create reusable components that saved over 150 hours of development time per month
• Created 100+ automated UiPath process that involves downloading files from webpages, capturing data from various sources, processing invoices
• Created process that pulls data from Salesforce to SQL database using dynamic queries thus saving Monthly recurring $100 licensing cost
• Created templates for new members of team for processes for easy and fast on-boarding

• Implemented business logic parameters for model execution.
• Identified, troubleshot and corrected bugs and bottlenecks.
• Developed mappings, workflows and tasks using Informatica
• Conducted data modeling, performance and integration testing.
• Designed and created ETL code installations, aiding in transitions from one data warehouse to another.
• Designed integration tools to combine data from multiple, varied data sources such as RDBMS, SQL and big data installations.
• Wrote and optimized in-application SQL statements.
• Collaborated with business intelligence staff at customer facilities to produce customized ETL solutions for specific goals.
• Managed data quality issues during ETL processes, directing qualitative failures to team lead for amelioration.
• Created automation scripts using PowerShell to edit 3000+ mappings to add house-keeping columns in database