Ayushi Mathur
Mumbai
Summary
Accomplished Senior Data Engineer with a proven track record across organisations, adept in migrating and transforming data using Azure Databricks and PySpark. Skilled in designing data pipelines and ensuring data integrity, demonstrating strong analytical capabilities and a strategic approach to problem-solving. Excelled in enhancing data quality and operational efficiency across multiple platforms.
Overview
6
6
years of professional experience
Work History
Senior Data Engineer
Wipro
Pune
03.2024 - Current
- Project: TD-Core Banking (Canadian banking client).
- Migrated multiple jobs from on-prem to Azure.
- Developed an Azure Databricks notebook using PySpark and SQL for data transformation.
- Developed orchestration codes as per the framework for scheduling ADF pipelines.
- I deployed the code in multiple environments using Bitbucket.
- Tested and compared the data between on-prem and cloud.
- Developed tools and applications for monitoring data quality and integrity across all applications and databases.
- Analyzed user needs and created logical models that met those needs while adhering to industry standards.
Data Engineer
AMDOCS
Pune
10.2021 - 03.2024
- Project 1: 3 UK (Client)
- Project Purpose: To migrate the pre-paid and post-paid customers from the legacy to the Amdocs system.
- It was also necessary to migrate the historical data according to the data retention policy.
- Role: Informatica Cloud Developer, along with data migration.
- Technology: IICS, Oracle, Unix shell scripting.
- Developed the code on the IICS tool, along with Unix and Oracle, to migrate the customers as per requirements.
- Manage assigned risks, and monitor potential impacts as part of the data migration plan.
- Performed source system data analysis in order to manage source-to-target data mapping.
- Project 2: CRMF (Client) Migration Gen 1 to Gen 2.
- Project Purpose: Migration of the data from ADLS Gen1 to ADLS Gen2.
- The key focus here was to migrate the historical data and load the everyday incremental data to the Gen2 Delta tables.
- Responsibilities: Migrated multiple applications from Azure Gen 1 to Gen 2.
- Implemented a Big Data component, such as Spark SQL, using Azure Databricks.
- Designed and developed ADF pipelines for data ingestion.
- Developed linked services and datasets for ADF pipelines.
Data Engineer
Tata Consultancy Services
Pune
10.2018 - 10.2021
- Project 1: UNFI (formerly SuperValu) (U.S. FMCG Client)
- Project Purpose: To provide a fast and efficient automated data model to feed the source data into the EDW data model, in accordance with the business need.
- Role: ETL Developer.
- Technology: Informatica, Unix, Teradata.
- Responsibilities: As part of the R&D team, I was responsible for developing an automated process and framework to generate the feed from different sources and load it into target databases.
- Performing cleansing and transformation as per the standards.
- Project 2: IPAR
- Project purpose: To extract a large amount of data into a simpler form according to the conditions provided by clients, and to design code accordingly.
- Role: ETL Developer.
- Technology: Informatica, SQL Server, Unix.
- Responsibilities: Was responsible for designing Informatica mappings of different SCD types.
- Created procedures in SQL Server as per the client's requirement.
Education
Bachelor of Engineering - Information Technology
Oriental Institute of Science And Technology
Bhopal, Madhya Pradesh, India06-2018
Central Board of Secondary Education (Certificate Exam) -
Jagrati Vidhya Mandir
Badnawar, Madhya Pradesh, India 05-2014
High School Diploma -
Kashyap Vidhya Peeth
Badnawar, MP05-2012
Skills
- Azure Data Factory
- ADLS (Azure Data Lake Storage)
- PySpark
- SQL Server database
- UNIX shell scripts
- Oracle Database
- Azure Databricks
- Informatica PowerCenter 1014
- Teradata Database
- Data Vault Modeling
- Data pipeline design
- Spark development
Accomplishments
- Was sent site to London (UK) for representation and deployment of project.
- Was recognized and appreciated by the client for deploying the code as per committed timelines.
Soft Skills And Strengths
- Work well independently and on a team
- Quick learner, Self-motivated, Problem-solver
- Good communication skills
- Excellent written and verbal communication skills.
Timeline
Senior Data Engineer
Wipro
03.2024 - Current
Data Engineer
AMDOCS
10.2021 - 03.2024
Data Engineer
Tata Consultancy Services
10.2018 - 10.2021
Bachelor of Engineering - Information Technology
Oriental Institute of Science And Technology
Central Board of Secondary Education (Certificate Exam) -
Jagrati Vidhya Mandir
High School Diploma -
Kashyap Vidhya Peeth
Similar Profiles
Mohil Pushpraj DhadgeMohil Pushpraj Dhadge
Senior DevOps Engineer at WiproSenior DevOps Engineer at Wipro
Harshit MishraHarshit Mishra
Associate analyst at WiproAssociate analyst at Wipro
RICHA KAPURRICHA KAPUR
Principal Consultant at WiproPrincipal Consultant at Wipro