Vineetha Jacob

• The LEAP D&A Legacy Migration project is to re-platform and modernize WBA data systems, leveraging Microsoft Azure capabilities, for the business to focus on core functions, leveraging cloud capabilities.
• The project objective is to ingest and curate retail data domains from the existing Hadoop/DB2 environment to the Azure environment and build a Global Data Hub.
• Design and implement migration strategies for traditional systems onto the Azure platform.
• Develop an Azure Data Factory pipeline for on-cloud ETL processing. Build complex stored procedures to facilitate efficient data manipulation and consistent data storage according to the business rules.
• Improved database performance and loading speed by 80% through SQL query optimization.

• Worked as a Data Engineer Major Commercial client based out of NZ, Involved in development activities for various use cases.
• Build a metadata driven ADF ingestion framework which extracts data from different source systems namely SAP, network drive, manual files, Teams Folders and API etc And orchestration of databricks notebooks using ADF and performed advanced transformations with Azure Databricks.
• Loaded transformed data into Azure SQL Server databases, ensuring optimal performance and adherence to data governance standard.

• Developed DMX-h ETL codes for Hadoop control checks to validate various Hadoop files.
• Developed DMX-h Map Reduce Jobs to run on a Hadoop cluster using various functions like copy, sort, merge, aggregate,lookup.
• Worked on Hive tables to load data, applied extraction logic on data and storing data into Hive target table for analysis.
• Used Change Data Capture (CDC) to simplify ETL in data warehouse applications.
• Involved in design and creation of Hive table and View schema.
• Developed Autosys scripts for Job execution, controlling, scheduling and monitoring and unix scripts to run DMX jobs to load Teradata Target Tables.

• Created Tables, Users,Views, Constraints, Index, Programmed packages, Stored Procedures, Functions.
• Successfully handled the needs of access grants,resolving deadlock issues.
• Worked extensively on Ref Cursor, Collections, Dynamic SQL.
• Handled errors using Exception Handling extensively for the ease of debugging and displaying the error messages in the application.
• Involved in integration testing, Issue Resolution and bug fixing .
• Designed and coded application components in an Agile environment.
• Applied DB scripts as patches using Maven – SQL plugin and DB deploy(Continuous Integration Tool).