Abhinaba Dass
Summary
Results-driven Big Data Engineer and Backend Developer with expertise in building scalable data platforms on AWS and Azure. Skilled in developing APIs and managing Databricks-based pipelines, utilizing Python, Java Spring Boot, and various databases. Committed to delivering high-performance and maintainable data solutions.
Overview
5
5
years of professional experience
1
1
Certification
Work History
Big Data Engineer
Vestas
06.2024 - Current
- Contributed to core product team for wind analytics platform, enhancing product functionality.
- Leading Azure Databricks development, driving architectural decisions and implementing scalable data solutions.
- Led and successfully delivered the migration of Databricks workloads from AWS to Azure, achieving 99.9% operational success.
- Delivered key features that improved data processing performance, alerting systems, and platform reliability.
- Collaborated with cross-functional teams to integrate and deploy data pipelines, ensuring operational continuity.
- Mentored junior engineers and established best practices in Databricks and cloud data engineering to elevate team capabilities.
Big Data Engineer
SmartBorn
07.2023 - 06.2024
- Developed Databricks solutions for wind analytics project, enhancing data processing capabilities.
- Designed scalable solutions, improving platform performance and maintainability.
- Led API development using Java Spring Boot, enhancing system capabilities.
Big Data Engineer
XenonStack
12.2020 - 06.2023
- Designed and implemented robust cloud-based analytical platforms using AWS services (Lambda, S3, EBS, Kinesis).
- Managed backend services for two big data analytical platforms, ensuring data integrity and availability for analytics.
- Built stream-processing systems with Spark Streaming and PySpark, facilitating real-time data analysis and decision-making.
- Developed and maintained Databricks notebooks and jobs to automate alert creation and streamline data processing workflows.
- Utilized Python for logical solutions and CRUD operations across MySQL, PostgreSQL, and MongoDB.
Education
Bachelor of Technology - Electronics and Communications
Techno India University
West BengalSkills
- PySpark
- Databricks
- Kafka
- Kinesis
- Delta Lake
- Airflow
- Docker
- Jenkins
- ElasticSearch
- Hive
- MySQL
- PostgreSQL
- MongoDB
- TSDB
- Redis
- PL/SQL
- Shell Scripting
- Python
- Git
- GitLab
- GitHub
- Linux
- AWS services
- Azure
- Microsoft Azure
Certification
- AWS Certified Cloud Practitioner
- Microsoft Certified: Azure Data Fundamentals
- Databricks Accredited Lakehouse Fundamentals
Accomplishments
- 3rd in City - National Science Olympiad 2013
- Internshala Student Partner - 2018
- Multiple client appreciation awards for solving complex problems, cost optimization of data pipelines, and on-time delivery of high-impact components (HICs)
Timeline
Big Data Engineer
Vestas
06.2024 - Current
Big Data Engineer
SmartBorn
07.2023 - 06.2024
Big Data Engineer
XenonStack
12.2020 - 06.2023
Bachelor of Technology - Electronics and Communications
Techno India University