Kalyan Roy
Kolkata
Summary
Senior Data Engineer with 12+ years of IT experience and 3.5+ years of expertise in data engineering, cloud-native solutions, and advanced analytics. Specialized in Microsoft Azure ecosystem (Data Factory, Databricks, Synapse, ADLS Gen2, Azure SQL Database) with strong knowledge of ETL/ELT pipelines, data lakehouse architecture, and big data platforms. Proven track record of building scalable pipelines, integrating machine learning models into production workflows, and optimizing data solutions to improve business outcomes. Skilled at data governance, CI/CD automation, and cloud migration strategies.
Overview
16
16
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Seamless Distribution AB
Kolkata, India
01.2023 - Current
- - Designed and implemented scalable Azure-based data pipelines using Data Factory, Databricks (PySpark/Scala), and ADLS Gen2.
- - Built ETL/ELT workflows enabling sales and distribution analytics across multiple regions.
- - Orchestrated workflows with Apache Airflow and Prefect ensuring high reliability and monitoring.
- - Integrated ML models (LightGBM, XGBoost, Prophet) for classification and forecasting.
- - Improved pipeline performance by 30% and reduced ML training time by 20%.
- - Contributed to Azure Synapse integration for advanced analytics and reporting.
Principal Software Engineer
Seamless Distribution AB
Bengaluru, India
12.2018 - 12.2022
- - Led automation initiatives building frameworks for REST API, Mobile, and Web applications.
- - Designed CI/CD pipelines for data and application deployments using Docker and Bamboo.
- - Collaborated with DevOps teams to streamline cloud migration and release processes.
- - Mentored junior engineers in best practices for automation, DevOps, and cloud engineering.
- - Implemented data quality checks and validation frameworks reducing release defects by 25%.
Software Engineer
Nomura Research Institute
Kolkata, India
08.2013 - 11.2018
- - Automated back-office financial processes including settlements, reconciliations, and compliance reporting.
- - Built automation scripts using Java, Selenium WebDriver, and Rest Assured improving QA efficiency by 40%.
- - Enhanced data integrity through automated validation checks across critical financial applications.
- - Collaborated with teams on migration of legacy systems to modern architectures.
Programmer
System Solutions
Kolkata, India
10.2009 - 07.2010
- - Developed and deployed web applications using .NET and SQL Server.
- - Implemented client-side validations with JavaScript improving user experience.
- - Designed and optimized database schemas ensuring system scalability.
Education
Master of Technology - Information Technology
01.2013
Bachelor of Engineering - Computer Science
01.2009
Skills
- Cloud: Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, ADLS Gen2
- Big Data: Apache Spark, PySpark
- Programming: Python, Scala, SQL
- ETL / ELT Pipelines
- Data Warehousing, Data Lakehouse Architecture
- Workflow: Airflow, Prefect
- DevOps: CI/CD Pipelines, Docker, Git, Maven
- Machine Learning Integration
- Data Governance, Data Quality
- Streaming Data (Kafka, Event Hub, Spark Structured Streaming)
Websites
Accomplishments
- Delivered enterprise-scale Azure data pipelines enabling real-time sales analytics.
- Reduced ETL job latency by 30% through pipeline optimization.
- Enhanced ML integration with Spark and Databricks, improving predictive accuracy.
- Recognized for mentoring junior engineers and leading automation best practices.
- Contributed to successful cloud migration and modernization initiatives.
Certification
- Big Data Master's Program (Trendytech)
- Oracle Certified Associate (OCA) – Java SE 7 Programmer I
- Microsoft Certified: Azure Data Engineer Associate (Future Plan)
Languages
English – Full Professional Proficiency
Hindi – Professional Working Proficiency
Bengali – Native Proficiency
Timeline
Senior Data Engineer
Seamless Distribution AB
01.2023 - Current
Principal Software Engineer
Seamless Distribution AB
12.2018 - 12.2022
Software Engineer
Nomura Research Institute
08.2013 - 11.2018
Programmer
System Solutions
10.2009 - 07.2010