Phillbert Victor Phinto
Chennai
Summary
Data Engineering Professional with over 2 years of experience in developing scalable data solutions and managing large-scale data ingestion. Expertise in ADF, Databricks, SQL, and PySpark, with a strong ability to build efficient ETL pipelines. Skilled in both cloud and on-premise environments, delivering actionable insights to enhance data-driven decision-making. Eager to work on AWS-based pipelines.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Programmer Analyst
Cognizant
Chennai
10.2022 - Current
- Onboarded as an Informatica developer, I started making changes to the existing mapping and monitoring the workflows in Autosys. I was making retrofit changes and validating the mapping.
- Later, I worked on the cloud migration of the project to Azure.
- Lead the ingestion team, Ingested the on-premises SQL Server data to the Azure ADLS using ADF (Azure Data Factory).
- Developed and modified the ingestion pipeline framework for the ingestion process from SQL Server to ADLS, ADLS to ADLS, and other source systems.
- Decreased the ingestion time by 20% by increasing the number of partitions while reading the data.
- Created Python and SQL scripts for ingestion validation.
- Monitored and debugged ingestion failures.
- Worked on converting Informatica mapping to Python notebooks using the Spark module (PySpark) and other functions to convert the existing transformations, such as lookups, joins, sorters, and aggregators, to Python code.
- Created reusable Python modules.
- Worked on complex SQL script preparation, leveraged SQL knowledge in building ETL pipelines in ADF.
- Managed Data Load Operations: Successfully handled data load processes. Proactively monitored load operations to identify potential issues.
Intern
Cognizant
Chennai
01.2022 - 06.2022
- Trained in Big data technologies and got hands-on exprerience in Hive,SQL,Python,Spark,Data Warehousing Concepts.
Education
Bachelor of Technology - Computer Science And Engineering
SRM University
Chennai09-2022
Skills
- Programming Languages: Python, SQL, PL/SQL, SparkSQL, PySpark
- ETL Tools: Azure ADF, Apache Hive, Databricks, and Informatica
- Cloud Platforms: Azure
- Databases: MS SQL Server, Azure SQL Server
- Issue Tracking Tools: Jira
- Delta Lake Tables
- Data warehousing
Certification
- Databricks Certified Data Engineer Associate Certification
- AZ 900
AUTOMATIONS
- Automated report validation using Databricks reduced manual effort by 75%
- Created a connection checker script that checks the connection of many source systems, which is a prerequisite for ingestion
- Created a script for the creation of tables from one database to another database in Databricks, reducing manual effort by 50%
Timeline
Programmer Analyst
Cognizant
10.2022 - Current
Intern
Cognizant
01.2022 - 06.2022
Bachelor of Technology - Computer Science And Engineering
SRM University
Similar Profiles
Navya VootlaNavya Vootla
Associate at CognizantAssociate at Cognizant
Preethi RPreethi R
Programmer Analyst at CognizantProgrammer Analyst at Cognizant
MANISHA REDDY KUCHANPALLYMANISHA REDDY KUCHANPALLY
Infra Dev Specialist at CognizantInfra Dev Specialist at Cognizant
Anuj PandeAnuj Pande
Security Engineer (Penetration Tester) at CognizantSecurity Engineer (Penetration Tester) at Cognizant
Srinithi MSrinithi M
Process Associate at HanDigital Pvt LtdProcess Associate at HanDigital Pvt Ltd