Skilled Big Data Engineer with 2+ years of excellent track record of designing and implementing efficient ETL processes. Proficient in PySpark, SQL, Hadoop, Apache Hive,Apache Spark and cloud based data Platforms.
Overview
2
2
years of professional experience
1
1
Certification
Work History
Systems Engineer
Infosys
01.2022 - Current
Worked on a large-scale Big data projects for finance domain to use, manage and leverage amount of data to generate insights.
Contributed to the development of Spark codes using Spark APIs leading to a 40% improvement in Data Processing.
Designed and deployed data and pipeline management frameworks at the intersection of infrastructure and software engineering.
Engaged in cross-functional collaboration, deciphering team requirements, and delivering refined solutions to meet specified needs.
Creating and managing Data storage solutions on Azure using Data lakes by authenticating with account key, SAS, service principal.