Hi, I’m
Dhrutiman Bhattacharjee
Kolkata
Summary
Young passionate data engineer with almost 2 years of experience in data engineering and analytics and a wide array of skills such as ETL, machine learning, data warehousing, data visualization, and many more. Apart from that, have worked for clients based in various domains like retail, sales intelligence, etc, and am capable of creating data extraction and transformation pipelines to ensure the continuous flow of clean data for data analytics and feature engineering. I'm an organized and dependable candidate successful at managing multiple priorities with a positive attitude.
Overview
2
years of professional experience
1
Certification
Work History
Coditas
Associate Software Engineer
07.2021 - 08.2022
Job overview
- Translate business propositions into quantitative SQL queries to collect and segregate the necessary data from the client mongo database and store the data in the PostgreSQL database.
- Actively engaged in the quantitative analysis and visualization and validated pipeline features using various python libraries like pandas and seaborn heatmaps, histograms, boxplots, etc, for a sophisticated ML model to address business requirements.
- Used various supervised learning algorithms like KNN, Naive Bayes, Decision Trees, and Random Forests to design a Sales Prediction machine learning model which deduces correlations in various pipeline features such as no emails sent, calls attended, etc. It helps predict the outcomes of any ongoing sales deal with clients and allows sales agents to choose prospects accordingly. It helped in improving the sales conversion ratio by 30%.
- Used reinforcement learning-based Multi Arm Bandit algorithms to develop a sales rewarding
system to generate a list of prospects that had the most chances of successful sales deals, thus
helping sales agents further approach the appropriate prospects accordingly. This resulted in
50% more conversations for the sales agents.
Coditas
Software Engineer
08.2022 - 12.2022
Job overview
- Worked with product team and senior engineers to design overall pipeline flow for incremental data load, required joins with source collections, and created the layout for dim and fact tables.
- Used Pyspark and other python libraries to create refined ETL pipelines to extract data from the client's server in MongoDb and perform transformation and loading of the data to the AWS Redshift database intended for data warehouse purposes.
- Implemented archival logic to retain previous changes in data type or format in various attributes of collections for future reference and regulatory compliance reasons. Every dim table has its archived version table.
- Collaborated with other fellow engineers to schedule Glue jobs for the running of driver functions for ETL operations of various tables and collections in AWS.
Coditas
Data Engineer
12.2022 - Current
Job overview
- Co-developed reconciliation scripts to fetch and display summary counts for all general, dim, and fact collections including both incremental and full load. This contributed significantly to the overall data validation process.
- Designed SES alert scripts to detect discrepancies and differences within counts for landing and mongo tables based on queries posted during the reconciliation jobs, thus helping senior engineers and analysts to find any potential issues with data integrity.
- Scheduled AWS Lambda job for the SES alert scripts and added exception handling scripts for all reconciliation scripts jobs.
Education
University of Engineering And Management Kolkata,West Bengal,India
B.Tech from Computer Science And Engineering
05.2021
Skills
- ETL(Pyspark,AWS Glue, Lambda)
- Python
- Machine Learning(Python Scikit Learning,Pandas)
- Data Warehouse(AWS Redshift)
- Exploratory Data Analysis (Python Seaborn, MatPlotLib)
- Data Extraction(SQL)
- Database Management(PostgreSQL,MongoDb)
- Quality Management
- Storage (AWS S3)
Certification
AWS Cloud Practitioners
Timeline
Data Engineer
Coditas
12.2022 - Current
Software Engineer
Coditas
08.2022 - 12.2022
Associate Software Engineer
Coditas
07.2021 - 08.2022
University of Engineering And Management
B.Tech from Computer Science And Engineering
Similar Profiles
Anjali RaiAnjali Rai
Project Manager & PMO at CoditasProject Manager & PMO at Coditas
Pratik ParikPratik Parik
Data Engineer at CoditasData Engineer at Coditas
Sabah AfzalSabah Afzal
Associate Project Manager at CoditasAssociate Project Manager at Coditas