Pooja Wattamwar

• Client: TD Bank.
• Project Title: Advanced Analytics.
• Platform Used: Databricks, Bitbucket, ADF Pipelines, and Synapse.
• Description: Worked with the client to gather requirements and provide the design to refactor the code base as per the requirements. Also created test cases for SonarQube analysis for code coverage, and helped the team set up VS Code for unit test case setup using the Pytest framework. Used the ADF pipelines for job onboarding, and moved the data from raw to target using Databricks, and the final data was stored on Synapse for further modeling purposes.

Project Title: Migration of AI Products to the Databricks Platform.

Platform Used: Databricks, AWS Buckets, Bitbucket.

Description: Directly worked with the client to gather requirements and provide the design to refactor the existing code base as per the. Databricks standard and contributed to the project by setting up a dummy Databricks platform and educating developers about it. The Databricks platform is in the initial phase. Also Worked on High- & Low-level design of the product. Decoded the existing on-premises code to rewrite the code according to Databricks standards. Supported project with Databricks use cases and Databricks challenges. Have

Worked on Databricks upgraded features like Unity Catalog, Volume, and Workflow, etc. And Helped team to setup VS Code using Databricks Compute

• Client: Mastercard
• Project Title: Mastercard Cloud Foundation
• Platform Used: Databricks, ADF, Synapse SQL Server
• Description: This is a Data foundation Project. Data is generated within Databricks using synthetic data generator using the reference from on prem data. It is handled by DLT Pipeline using platforms like Azure Databricks and ADF DevOps. Once data is generated then it is forwarded to the AI/ML team for further Algorithm Development.

• Project Title: Netezza Decommission
• Platform Used: Databricks, ADF, Synapse SQL Server
• Description: This is a Data Migration Project. Data is migrated from Netezza warehouse to Cloud environment. It is migrated using platforms like Azure Databricks, ADF Devops and Synapse SQL Server.
• ROLES & RESPONSIBILITIES
• Interacting with project management to understand objectives and how they want to achieve them.
• Active participation in Data Migration development by interacting with project teams.
• Design and implement requirements in Databricks, provide Coding, Maintenance and Enhancement support.
• Analyzing mapping documents and requirement gathering. Architecture in SQL and make it compatible with Synapse.
• Getting the files into a blob from FTP/SFTP using the Stone branch tool.
• Automated all Stone branch jobs to copy the files automatically.
• Batch Data sources are ingested by creating a pipeline using Azure data factory.
• ADF is used for the ingestion of on-premises data into Azure data lake storage.
• Written the SQL code for ingestion in Databricks notebooks.
• Deployed distributed data processing systems using the Azure ecosystem such as Azure Data Bricks.
• Used the Azure Key Vault service to store secrets and keys used for encrypting the storage & Service Principle for authentication to access Azure resources.
• Created ADF pipeline for each source & scheduled for automating monthly/weekly jobs.
• Handling Team of seven Interns and Trainees, responsible for their training and Project deployments
• Actively volunteers in interns’ technical improvement programs every week.