Shantanu Bit
Senior Data Engineer
Pune,Maharashtra
Summary
Detail-oriented and results-driven Senior Data Engineer with 4 years of experience in designing, implementing, and optimizing data pipelines on Azure Cloud Platform. Proven track record of leveraging cloud-based technologies to drive actionable insights and support decision-making processes.
Overview
4
4
years of professional experience
Work History
Senior Data Engineer
Brillio Technologies Pvt Ltd
Pune, Maharashtra
04.2023 - Current
- Designed and implemented scalable data pipelines on the Azure Cloud Platform to process and analyze large volumes of data, resulting in a 30% improvement in data processing efficiency.
- Optimized data storage and retrieval mechanisms using Azure Data Lake Storage and Azure SQL Data Warehouse, reducing query response times by 20%.
- Responsible for creating logical and physical data models that support the principles of data modeling and dimensional modeling.
Data Engineer
Brillio Technologies Pvt Ltd
Pune, Maharashtra
12.2021 - 03.2023
- Designed and implemented an effective database solution supporting more than 17 Power BI reports using Azure Data Factory, Azure SQL Database, Logic Apps, and Azure Blob Storage.
- Developed an automated solution for syncing data between 2 internal servers and 3rd-party tools using Power Automate Flow and REST API, reducing manual effort by 70% while meeting SLAs.
- Conducted performance analysis and optimization of data processing workflows, resulting in a 25% reduction in resource utilization and cost savings.
- Enhanced CI/CD pipelines, led code reviews, conducted Azure DevOps audits, and updated pipeline documentation.
Data Science Engineer
Wiz Panda Techno Solutions
Pune, Maharashtra
09.2020 - 11.2021
- Developed an image personalization module using the Google Vision API and the Mask RCNN model to generate a personalized banner for push/in-app notifications, responsible for increasing the retention rate by 38%.
- Assisted in developing a hybrid recommendation system that recommends items based on the number of user interactions and the type of user events in the client’s mobile application, responsible for increasing product sales by 21%.
- Designed a FLASK API to provide real-time insights data for the customer’s analytics dashboard, which includes mobile app KPIs and RFM analysis.
Intern
Technogeeks
06.2018 - 12.2018
- Assisted in the development and implementation of Hadoop-based solutions using tools such as HDFS, MapReduce, and YARN.
- Participated in data ingestion processes, utilizing Apache Flume and Apache Kafka to efficiently collect and transport data into Hadoop clusters.
- Contributed to data processing and analysis tasks using Hive and Pig, optimizing queries and scripts to improve performance.
- Ad hoc analysis and insights report generation.
Education
Diploma - Data Science
Radical Technologies
Pune, India06.2020
Bachelor of Enginerring - Information Technology
Shri Shankaracharya Group of Institutions
Bhilai, India06.2019
Skills
- Hive
- Hadoop
- Git
- Power BI
- Logic Apps
- Power Automate Flow
- Azure Synapse Analytics
- Azure Data Factory
- Azure SQL Database
- MongoDB
- Python
- SQL
Timeline
Senior Data Engineer
Brillio Technologies Pvt Ltd
04.2023 - Current
Data Engineer
Brillio Technologies Pvt Ltd
12.2021 - 03.2023
Data Science Engineer
Wiz Panda Techno Solutions
09.2020 - 11.2021
Intern
Technogeeks
06.2018 - 12.2018
Diploma - Data Science
Radical Technologies
Bachelor of Enginerring - Information Technology
Shri Shankaracharya Group of Institutions