BIPRAJIT MUKHERJEE

nWorking in Supply Chain industry with experience in Reverse Logistics for Intel.

• Migrating all the on-premise data warehouses to Azure Cloud while performing ELT on the data to provide useful business insights to business users.
• Migrating all the SQL jobs using orchestration in ADF and using PySpark to efficiently transform the Raw data which is received from multiple sources like (ECC, Salesforce, SQL Server, FTP files etc.) and merge the data to ensure highest of data quality.
• We are using Snowflake as our data warehouse to store and expose the required data to other stakeholders to be used in their reports.
• On the reporting side we have migrated the on-premise OLAP reporting service to PowerBI semantic models.
• Optimizing databricks notebooks to ensure jobs did not break any SLA so that business is not impacted.

• Jul 2019 - Dec 2020 - Developing backend services in Python and
  automating tasks using Python Selenium to reduce manual work.
• Jan 2021 - Present - Working as an Azure Data Engineer for one of the largest Retailers in North America to migrate data from on-premise to Azure cloud storage.
• Developing and maintaining pipelines to migrate data everyday through Azure Data Factory, Azure DataBricks and PySpark while doing ADRM transformation to data as per the requirement while also identifying and mitigating risks in the process.
• Improved the performance of Spark-based data integration
  framework by implementing industry best practices, resulting in 40% increase in performance.
• Taking initiative to suggest and execute measures to prevent job failures.
• As a Data Engineer I have migrated data from multiple
  on premise i.e. Teradata , DB2, SQL Server to Azure.
• I have worked on to create common and streamline data migration
  pipeline through Azure Data Factory to migrate the Historical as well as
  Transactional systems.
• I have worked on to migrate the data from several Legacy applications
  to Azure which allowed the client to deprecate the Legacy systems and
  use the data in Azure to get useful business insights and better reporting
  for the business.