Shweta Kadam
Data Engineer
Pune
Summary
Software Engineer with expertise in Big Data, leveraging over 3 years of experience at Tech Mahindra. Results-driven Data Engineer with hands-on experience in designing and building scalable data pipelines using Azure Cloud services and Big Data technologies. Proven expertise in developing metadata-driven ETL solutions, implementing data quality frameworks, and ensuring efficient data ingestion and transformation. Adept at working with structured, semi-structured, and unstructured data sources to deliver reliable and real-time insights.
Overview
4
4
years of professional experience
3
3
Certifications
3
3
Languages
Work History
Software Engineer
Tech Mahindra
05.2023 - Current
- Project Experience
- Company: Tech Mahindra
- Work Location: Pune
- Domain: HealthCare
- Project Name: Revenue Cycle Management (RCM) Data Platform
- Duration: May 2023 – Feb 2025
- Skills: Azure Data Factory, Azure Databricks, ADLS Gen2, Azure Key Vault, SQL, APIs, SCD Type 2, Audit Logging, Data Quality Checks
- Project Summary: Developed a metadata-driven data platform to streamline the hospital’s Revenue Cycle Management (RCM), focusing on Accounts Receivable (AR) tracking. The solution provided real-time visibility into financial KPIs such as Days in AR, aging receivables, and collection efficiency, empowering timely follow-ups with patients and insurers. Leveraged Azure services to build scalable pipelines that ingested, enriched, and transformed multi-source data into a gold layer optimized for reporting.
- Key Responsibilities:
- Designed and implemented metadata-driven pipelines in Azure Data Factory to automate full and incremental data loads from SQL databases, flat files, and APIs.
- Ingested data into Azure Data Lake Storage Gen2 using Parquet format for efficient downstream processing.
- Applied SCD Type 2 data modelling in Databricks for historical tracking and clean data structuring.
- Configured scheduled and event-based triggers in ADF for automated ingestion of recurring and real-time data files.
- Integrated Azure Key Vault for secure credential management and implemented audit logging for data traceability.
- Enabled end-users to track critical financial KPIs through clean, timely, and reliable datasets.
Associate Software Engineer
Tech Mahindra
12.2021 - 01.2023
- Project Name: Credit Risk Analytics Platform
- Domain: Finance / Digital Lending
- Duration: Dec 2021 to Jan 2023
- Skills: PySpark, SQL, Data Lakes, Hive
- Project Summary: Built a data processing solution for a digital lending company focused on personal and education loans. The objective was to analyze borrower risk based on repayment behavior by creating a unified and cleansed dataset from multiple systems. Developed PySpark workflows to clean, transform, and standardize raw loan data, enabling accurate credit risk modeling. Implemented privacy-safe hash-based identifiers to track borrower activity while maintaining data security and compliance.
- Key Responsibilities:
- Developed PySpark-based ETL pipelines to clean, transform, and standardize raw data from diverse sources.
- Handled data quality issues such as missing values, duplicates, and inconsistent formatting using rule-based logic.
- Created hash-based unique identifiers for each loan application to support privacy and trackability.
- Applied domain-specific business rules to enrich the data for analytical readiness.
- Combined multiple data streams into a unified borrower activity view, enabling downstream credit risk scoring models.
- Collaborated with analytics teams to ensure data outputs aligned with modeling requirements and compliance standards.
Education
BE - Computer Science
N.B Navale Sinhgad College Of Engineering, Punyashlok Ahilyadevi Holkar Solapur University
Solapur, Maharashtra06.2020
Skills
- Apache spark
- Big Data
- Python
- Azure
- HDFS
- ADLS Gen2
- Pyspark
- SQL
- Azure Synapse
Certification
Microsoft Certified: Azure Fundamentals (AZ-900)
Awards
Recognized with 'BRAVO' award., Date: 20 March 2023
Tools
Azure Data Factory (ADF), Azure Databricks, Git, GitHub, Confluence, VS Code, Jira.
Timeline
Software Engineer
Tech Mahindra
05.2023 - Current
Associate Software Engineer
Tech Mahindra
12.2021 - 01.2023
BE - Computer Science
N.B Navale Sinhgad College Of Engineering, Punyashlok Ahilyadevi Holkar Solapur University