HARSHIT GOYAL

Azure Data Architect: - Designed and implemented the Data engineering pipeline for Pricing team for Cost, Pricing and Quotes use cases for B2B clients using these Azure Eco system services: Azure DevOps, Power BI ,Azure Data Factory, Azure Data Bricks (Pyspark, Unity Catalog), Microsoft Entra ID, Azure Key Vault, Azure Data Lake Gen 2, Azure Storage Account, Azure Synapse Analytics, Azure Logic App, Azure Log Analytics , Azure Function App , Azure Data Explorer, Azure Monitor, Azure AKS

• Big Data Application Migration into Azure Stack: - Completed 6 Big data Applications migration in Azure from Hadoop OnPrem Cloudera Environment into Azure Services
• Application migration was re-engineered using these services: Azure Data Factory, Azure Data Bricks, Azure DevOps, Azure Key Vault, Azure Data Lake Gen 2, Azure Storage Account, Azure Logic App, Azure Log Analytics, Azure Function App.

• Completed the 4-user stories in Azure cloud
• Data Migration into Azure: - Completed use case where I have migrated the data from Hadoop OnPrem Cloudera Environment into Azure Services
• Data migration was re-engineered using these services Azure Data Factory, Azure Data Bricks , Azure DevOps, Azure Key Vault ,Azure Data Lake Gen 2, Azure Blob Storage Account, Azure Logic App, Azure EventHub
• Data Processing in Azure: Completed one data processing pipeline in Azure

• Supports POC initiatives to explore Hadoop ecosystem.
• Used Hive to analyse data in HDFS
• Handling and maintenance of development and testing environments
• Payment Reporting: - Worked on one of the requirements for Payment Transformation
• Create one automated process in Oozie and Impala to create the aggregate data set in Hadoop for Payment Monitoring, Alerting and Reporting
• Regulatory reporting for Loan Products: - Provide the end-to-end solution for two loan bank wide products (Mortgage and Business Term loans) used Hive, Impala, Sqoop, Oozie and shell Script to make it Automated

• Project: Corporate Actions Processing Engine (CAPE) : TCS BaNCS (Corporate Action) - TCS BaNCS is the market leading product catering to the needs of Banking, Insurance & Capital Market
• The system takes cares of capturing various Corporate Actions announced in the market, cleansing and distribution of data regardless of source or format, capturing of response, calculation of entitlements, generating the correct transactions and notifications to create more efficient and proactive operations
• L3 supports over 32 live countries
• Handling and maintenance of development and testing environments L3 Support