Summary
Overview
Work History
Education
Skills
Interests
Timeline
Generic

Rashmi Sahu

Azure Big Data Engineer
Bengaluru

Summary

  • Dedicated and results-oriented Cloud Data Engineer with over 5.5 years of experience in ETL, Database and application development, coupled with 2.5+ years of Relevant experience as an Azure Data Engineer.
  • Proficient in Azure Data Factory, Azure Databricks, Azure Synapse Analytics.
  • Good Experience in architecture and components of Spark, and efficient in working with Spark Core, Data Frames/Data Sets/RDD/Spark SQL, and expertise in building PySpark applications for interactive analysis and batch processing.
  • Good experience in Databricks Delta Table, Lakehouse architecture with a focus on Delta Lake technology.
  • Knowledge in Data Warehouse Concepts in OLTP/OLAP System Analysis.
  • Proficient in working with a variety of file formats, including CSV, PARQUET and JSON.
  • Good experience in the Digital Marketing, Trade Exhibition domain, showcasing a deep understanding of Revenue, P&L, Orders, Sales, and collateral data.
  • Involved development of Azure CI/CD pipelines to facilitate seamless deployment of Azure components.
  • Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using SQL Server and SSIS Packages.
  • Proficient in SQL Server Development/T-SQL which includes Stored Procedures, CTE, Indexes, Joins, Subqueries, Views, Analytical Function and Windows Function etc.

Overview

6
6
years of professional experience
6
6
years of post-secondary education
3
3
Languages

Work History

Azure Data Engineer

Brillio Technologies
02.2020 - Current
  • Worked closely with Business Analysts and End Users for gathering requirements and providing technical solutions during design phase.
  • Created Pipelines in Azure Data Factory using Linked Services/Datasets/Pipeline/ to Extract, Transform, and load data from different sources like Azure SQL, Azure Synapse Data Warehouse.
  • Created transformations using Dataflow activity using various transformations like JOIN, FILTER, ALTER ROW etc. to extract and transform and load the data to targets like Azure SQL DB, ADLS Gen2 and Azure Synapse Data Warehouse.
  • Created Clusters and Notebooks in Azure Databricks using PySpark for data extraction, transformation, and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage.
  • Created external tables in azure synapse Serverless SQL Pool and created SQL queries to query the insights of the data through external tables from Data Lake.
  • Created tables in Synapse Dedicated SQL pool using hash distribution and round robin distribution for facts and dimensions tables.
  • Ingested data from a variety of file formats, including CSV, PARQUET, JSON and loaded into Delta Lake table.
  • Crated release pipeline to deploy the code into various environments like INT, UAT using Azure DevOps release pipeline through ARM template.
  • Successfully collaborated with cross-functional teams to develop and implement data-driven strategies, resulting in improved efficiency and data accuracy.

MSBI Developer

Theorem India Pvt Ltd.
12.2018 - 02.2020
  • Extensively working in Data Extraction, Transformation and Loading from source to target system using SQL Server Integration Services.
  • Creation of workflows with Data Flow Task, Script Task, Execute SQL Task and Containers.
  • Used Transformations like Derived Column, Conditional Split, Aggregate, Multicast, Merge Join, Data Conversions and Union all.
  • Optimizing SSIS package performance.
  • Optimizing ETL process.
  • Handling error and debugging of packages and fixing package failures during runtime
  • Creating Package Configurations, Loggings and deployed SSIS packages into PROD server
  • Involved in Design, Development, Testing, and Implementation of Database Design.
  • Hands on Debugging, Error Handling SQL scripts

Associate Software Engineer

Shakti IT Services Pvt Ltd.
10.2018 - 12.2018
  • Worked here to support the existing process in SQL Server and SSIS Packages.
  • Have implemented new business requirements in an existing pipeline as per the business need.

Education

Master of Computer Applications - Computational Science

Kalinga University
Naya Raipur, India
07.2015 - 06.2017

Bachelor of Computer Applications - Computational Science

Utkal University
Bhubaneswar
05.2011 - 06.2015

Skills

Azure Databricks

undefined

Interests

Playing Cricket

Watching Web Series

Timeline

Azure Data Engineer

Brillio Technologies
02.2020 - Current

MSBI Developer

Theorem India Pvt Ltd.
12.2018 - 02.2020

Associate Software Engineer

Shakti IT Services Pvt Ltd.
10.2018 - 12.2018

Master of Computer Applications - Computational Science

Kalinga University
07.2015 - 06.2017

Bachelor of Computer Applications - Computational Science

Utkal University
05.2011 - 06.2015

Similar Profiles

CREATE PROFILE
Rashmi SahuAzure Big Data Engineer