Subarna Kirtaniya
Data Engineer
South Dumdum,Kolkata
Summary
Data engineer with 3+ years of experience in building and automating ETL pipelines and data warehouses. Expertise in Python, SQL, Spark, Airflow, and Databricks to deliver scalable big data solutions. Enhanced processing efficiency in retail and hospitality sectors, driving data-driven decision-making.
Overview
3
3
years of professional experience
4
4
Certifications
3
3
Languages
Work History
Data Engineer
Circana
02.2024 - 08.2025
- Developed data engineering solutions using Python, SQL, Hadoop, Shell scripting, and PySpark.
- Designed and implemented data workflows in Astro Airflow to automate JSON data ingestion from REST APIs.
- Engineered a distilled data layer for analytics and reporting.
- Utilized Databricks and Airflow to ensure high-quality, timely data processing.
- Wrote well-tested code and troubleshot discrepancies.
Software Engineer
Harman
03.2022 - 01.2024
- Utilized Python, SQL, Spark, and Hive to deliver data engineering solutions.
- Designed a data warehouse using store-level POS data for a retail platform.
- Collaborated with cross-functional teams to gather requirements and ensure successful delivery.
Education
Bachelor of Technology - Computer Science and Engineering
Dr. Sudhir Chandra Sur Institute of Technology
Kolkata01-2022
Skills
Structured Query Language (SQL)
Python programming
PostgreSQL database
Apache Spark
Data analysis
ETL/ELT processes
Dataframe APIs
Control management
Subversion (SVN)
Shell script development
Hadoop framework
Data management with Databricks
Data warehousing
Apache Airflow
Visual Studio Code
Power BI
Jenkins CI/CD
Jira management
Amazon Web Services (AWS)
REST API development
Certification
Training on Full Stack Web Development using PHP and MySQL
Timeline
Data Engineer
Circana
02.2024 - 08.2025
Software Engineer
Harman
03.2022 - 01.2024
Bachelor of Technology - Computer Science and Engineering
Dr. Sudhir Chandra Sur Institute of Technology