Ayush Mishra

Client: Unilever Project: UDL

Employer: Capgemini Technology Services. Duration: Aug 2022 – Till Date

Role: Associate Consultant

Work Location: Gurgaon (INDIA)

Technologies: Azure Data Lake, Azure Data Factory, Azure Blob Storage, Azure Databricks (PySpark), Logic App, DevOps.

Unilever is interested in creating a Universal Data Lake which acts as a single source of truth because they are getting their data from different source systems in different teams. So, they are facing the challenge of data redundancy and network, to overcome this problem they launched this UDL project.

• · Worked closely with business analysts, and other teams to understand data requirements and translate them into technical solutions that support analytics and reporting needs.
• · Involved in the development of a pipeline to streamline data between SharePoint, SFTP, Network File Share Path, Data Lake, Blob Storage and Sql Database, SAPHANA.
• · Writing PY-SPARK code using Databricks to incorporate business logic and implement Azure Delta Lake.
• · Involved in orchestrating and scheduling the jobs in Azure Data Factory.
• · Involved in the Complete Deployment process of QA, UAT & Prod Environment using DevOps CICD.
• · Involved in automating the basic testing summary report.
• · Monitor data pipelines, identify, and address performance issues, troubleshoot integration challenges, and maintain overall health of data solutions in Azure.