Open To Work
DEBAYAN DAS
IT
Bengaluru,KA
Summary
Data Engineer with a strong track record in designing and optimizing ETL pipelines. Leveraged Python, PySpark, and Azure Data Factory to improve scalability and efficiency while automating workflows. Collaborated with data scientists and business stakeholders to deliver reliable data solutions that drive analytics and machine learning capabilities.
Overview
4
4
years of professional experience
3
3
Certification
Work History
Analyst / Data Engineer
Tredence
Bengaluru
06.2021 - 02.2025
- Designed and optimized enterprise ETL pipelines using Azure Data Factory and Databricks.
- Migrated large-scale data workloads from Pandas to PySpark, significantly improving scalability and execution efficiency.
- Developed SQL and BigQuery stored procedures for high-volume data processing and reporting.
- Executed data validation and root-cause analysis to resolve production issues swiftly.
- Automated recurring workflows, minimizing manual operational effort and enhancing efficiency.
- Collaborated with data scientists, engineers, and business stakeholders to develop and implement reliable data solutions.
Education
B.Tech. - Electrical & Electronics Engineering
SRM Institute of Science And Technology
Chennai06-2021
Skills
- ETL Pipelines
- Data Modelling
- Data Quality Validation
- Machine Learning
- Python
- PySpark
- SQL
- Databricks
- Azure Data Factory
- BigQuery
- Data processing
- Workflow Automation
- Cloud Technologies
- Git
Certification
- Databricks Certified Data Engineer Associate
- Programming for Everybody (Python)
- Introduction to Artificial Intelligence (NPTEL)
Projects
- RaceTrac, Built Azure Data Factory pipelines for complex enterprise data workflows., Implemented SCD Type 2 logic for historical data tracking and governance.
- TALP-AEO, Developed high-performance BigQuery procedures and migrated data processing from Pandas to PySpark.
- Unilever, Built forecasting models and performed trend analysis to support business decision-making.
Right To Work
Eligible to work in the UK under the Youth Mobility Scheme.
Languages
Bengali
Native language
English
Proficient (C2)
C2
Hindi
Proficient (C2)
C2
Japanese
Beginner (A1)
A1
Timeline
Analyst / Data Engineer
Tredence
06.2021 - 02.2025
B.Tech. - Electrical & Electronics Engineering
SRM Institute of Science And Technology