Siddhant Dwivedi

• Working on creating optimized ADF pipelines to ensure the data flow from all layers.
• Working on creating ADF pipelines to generate optimized pipelines for the business end users and stakeholders to generate high value data reports.
• Working on creating automated pipelines for data load and data refresh.
• Worked on creating automated pipelines in ADF to regularize the use of storage and also to reclaim back the unused memory from different databases so as to save cost.
• Working on creating optimized AAS models for different Brands so as to save cost and optimize the flow of data into reports to business end users.
• Worked on creating an automated script to add partitions for the whole year in the AAS server in one go.
• Worked on creating automated Power Bi report to validate and do data validations on the data coming from different sources.

• Helped the StartUp to build and apply cloud based solutions for the process build.
• Managed and helped the team to build the PAAS from scratch with latest technologies enabled.
• Worked on Data level Security and optimization of ADF pipelines and AAS cubes for a better data flow.

Consultant | January 2023 – September 2023 (Project - 5)

Part of Core Team of the project handling and helping multiple teams divided on basis of different Regions for Europe specific market.

• Working directly with the client for providing them different analytical reports through PowerBi based on different datasets.
• Working with different Squad leads in setting up the different resources, storage accounts, cube creations, data transformation and data loads.
• Created CI/CD pipelines to migrate codes to different environment using Azure Devops.
• Working on data loads for different tables into medallic layers then into sql and finally into AAS cubes.
• Created end to end to ADF pipelines for data movement from multiple sources to cube level. Also created automated flow for daily run of pipelines and shooting alert messages in case of any failure
• Works closely with the Sanity check team to figure out on any missing data and bugs in the system.
• Completely responsible for maintaining all the resources and data under Production Environment end to end and help the client directly with going live with the product created.

Consultant | March 2022 – September 2022 (Project - 4)

Worked as a data engineer for data mapping coming through multiple retailer platform to the data structure and handle the volatility in the data.

• Worked on development and designing of Data Models.
• Developed and implemented SQL codes to read data from different sources and transform them and provide it to Data Science team for analysis.
• Wrote spark SQL codes for handling data volatility in Databricks and loading the data back in database using SQL.
• Worked on building end to end data flow pipeline in ADF, reading data from Databricks loading it in AAS cube. Also created automated flow for daily run of pipelines and shooting alert messages in case of any failure.

Consultant | October 2021 – February 2022 (Project - 3)

Worked on development and designing of different Data models of the project for providing Master data for FMCG for three specific business use cases within the SQRC (Safety, Quality, Regulatory and Compliance) function at organization.

• Worked on development and designing of Data Models for different scenarios.
• Worked on modelling the data and preparing the AAS cube to be used as data source for analytics purpose in Power Bi.
• Worked on building design for historical data reprocessing which helped the organization to grow their business by closely analyzing the changes over the years and building the predictive analytical model based on the design.

Analyst | October 2020 – September 2021 (Project - 2)

Implemented an integrated Data Warehouse with people data from HCM software application, Payroll data and other data from enterprise systems (e.g., finance).

• Worked on development and designing of Data Models in Synapse Analytics.
• Identifying necessary Azure resources required for the end-to-end implementation.
• Developed and implemented SQL/MySql codes required within the SQL Server (SSMS) to read data from ADLS and process.
• Developed and deployed different cubes in AAS.
• Read, Transformed and Ingested data in different layers of the model through SSMS.
• Implemented data warehousing and was completely responsible of deploying the codes using AAS and CI/CD pipelines.
• Build Row Level Security model and security policies using DAX commands for different level of authorities in organization.

Analyst | March 2020 – September 2020 (Project - 1)

Was a part of the training team and technical support team for a banking industry in delivering them end to end training on Google Cloud Platform components related to Artificial Intelligence and Machine Learning.

• Created detailed training documents/Study Material for each component of GCP.
• Created and designed practice activity of each component.
• Created and designed a mini project for practice, including all the components.

• Worked as the Product developer for different courses of cloud Platforms like Azure, AWS and GCP.
• Created end to end study material for the different cloud platforms with each resource implementation in a mini projects.

Worked on the organization's Sales data to create different predictive modules and study different trends in the growth of the company.