Summary
Overview
Work History
Education
Skills
Websites
Certification
Timeline
Generic

Shubham Parasar

Bangalore

Summary

Software/Data Engineer with 5+ years of experience across diverse domains, specializing in building extensible, maintainable, and scalable applications. Proven track record of contributing to end-to-end data engineering solutions, providing data warehousing architecture, and creating data pipelines.

Overview

6
6
years of professional experience
1
1
Certification

Work History

Software Development Engineer 2/ Data Engineer

Sigmoid
Bangalore
09.2021 - Current
  • Developed a file-modification–driven data pipeline to ingest datasets from SharePoint into Delta Lake, enabling near-real-time updates
  • Leveraged Azure Logic Apps, Data Factory, Data Lake storage and Databricks to automate orchestration, transformation, and scalable storage of structured data.
  • Engineered identity based resolution workflows to consolidate PII data from 5 different sources, resolving customer identities and behaviour to create unified customer profiles for marketing campaigns.
  • Built end-to-end pipelines for ingestion and transformation of large structured/unstructured data into Azure Data Lake Storage (ADLS) using PySpark/Databricks, ensuring GDPR compliance for PII encryption in European markets.
  • Redesigned MongoDB schemas and migrated nested data to flattened Parquet format, slashing Amperity processing time from 8 hours to 3 hours (60% improvement).
  • Collaborated with cross-functional teams to define business rules and created role-specific views and tables using Spark SQL to support Power BI reporting needs across diverse business functions tasks

System Engineer

Tata Consultancy Services
Kolkata
09.2019 - 09.2021
  • Contributed to the development of an Asset Management System using Spring Boot, Java, and SQL for ITSM Azure org, streamlining asset sharing and replacing legacy tools to improve execution speed and reduce costs.
  • Automated Azure VM monitoring and monthly patching by developing end-to-end PowerShell scripts for backup/update failure notifications and reducing manual effort and execution time tasks

Education

Bachelors of Technology -

Techno India college of Technology
Kolkata, India
06.2019

Skills

  • Programming languages: Python, SQL, Java
  • Distributed system: Apache Spark, PySpark, Delta Table, Delta Lake
  • Cloud and data platforms: Azure, Databricks, Data Lake, Data Factory, Key Vault, Logic Apps, and data warehousing (Azure Synapse)
  • Databases: MySQL, MongoDB
  • DevTools: Git, VS Code, IntelliJ
  • Other skills: Data modelling, ETL/ELT
  • Secondary skills: Java, Spring Boot

Certification

  • Databricks Certified Data Engineer Associate | 2024

Timeline

Software Development Engineer 2/ Data Engineer

Sigmoid
09.2021 - Current

System Engineer

Tata Consultancy Services
09.2019 - 09.2021

Bachelors of Technology -

Techno India college of Technology

Similar Profiles

CREATE PROFILE
Shubham Parasar