Results-driven data solutions professional with over 6 years of experience in designing and implementing robust data architectures. Proficient in Azure Data Factory, Azure Databricks, PySpark, and Power BI, with a proven track record of integrating diverse databases to create customized reports and dashboards that align with client objectives. Expertise in optimizing ETL processes through innovative transformations and event-driven workflows enhances operational efficiency and data accuracy. Strong analytical skills facilitate the extraction of actionable insights from large datasets, empowering informed decision-making and fostering effective team collaboration.
Overview
5
5
years of professional experience
2
2
Certifications
2
2
Languages
Work History
Senior Data Engineer
Xebia
06.2025 - Current
Architected and developed: Real-time streaming pipelines in Azure Databricks to process high-velocity passenger and booking data from Azure Event Hub.
Designed and implemented: Scalable data ingestion frameworks using PySpark, ensuring fault-tolerant handling of structured and semi-structured streaming events.
Applied transformations and aggregations: Leveraged PySpark/Spark SQL to deliver analytics-ready datasets for reporting and downstream systems.
Integrated systems: Connected Azure Event Hub with Cosmos DB, enabling low-latency writes of curated datasets to support operational dashboards and analytics.
Implemented reliability features: Applied checkpointing and Delta architecture for exactly-once processing in high-throughput pipelines.
Collaborated with business teams: Designed Cosmos DB collections with optimized partitioning and indexing, improving query performance by 35%.
Developed monitoring and alerts: Built dashboards and real-time alerts to ensure SLA compliance and minimize downtime.
Enforced governance and security: Integrated Azure AD with role-based access controls to strengthen data governance across pipelines.
Data Engineer
Assurant Automotive Warranty Solutions
06.2023 - 06.2025
Azure Ecosystem : Designed end-to-end pipelines in Azure Data Factory, integrating SQL Server, REST APIs, and cloud storage with parameterized triggers and reusable data flows.
Cloud Migration Leadership: Led on-premises to Azure migrations, converting data to Parquet in ADLS Gen2 via Databricks, with secure governance through Unity Catalog.
ETL & Data Transformation: Built high-performance ETL pipelines in PySpark/Spark SQL with complex joins, aggregations, and logic for scalable, reliable datasets.
Performance Optimization: Optimized ADF pipelines and ETL workloads using partitioning, caching, and indexing—cutting execution times significantly.
Azure DevOps Proficiency: Managed Git repos, CI/CD pipelines, and Agile workflows, automating deployments for faster, error-free delivery.
SQL & DWH Skills: Enhanced ETL and DWH operations using SQL Server; developed scalable SSIS solutions and optimized warehouse structures for analytics readiness.
Troubleshooting & Collaboration: Resolved production issues swiftly, conducted root cause analysis, and collaborated with cross-functional teams for scalable solutions.
Monitoring & Support: Proactively monitored pipelines and BI systems, ensuring SLA compliance with ServiceNow-driven incident resolution.
Collaboration & Innovation: Partnered with cross-functional teams to resolve production issues, perform RCA, and deliver client-focused, future-ready solutions.
Software Engineer
One97 Communication
10.2021 - 06.2023
DWH Leadership: Key contributor to Data Warehousing (DWH) team, managing high-volume telecom data (Airtel, Vodafone, Idea) for efficient analysis and reporting.
Client Collaboration: Spearheaded requirements gathering, aligning ETL and DWH solutions with client goals to deliver actionable insights.
Data Integration Expertise: Extracted and consolidated data using SQL, SAP BO, Putty, and Linux, ensuring seamless integration into centralized systems.
Data Quality Assurance: Implemented shell script-based purging and cleansing, upholding integrity across large datasets.
Big Data Optimization: Utilized Hadoop and Hive queries for storing, analyzing, and reconciling massive datasets, boosting performance.
Project Management: Tracked tasks via JIRA, ensuring timely updates, issue resolution, and on-schedule delivery.
Azure Ecosystem : Extensive experience with Azure Data Factory, Azure Data Bricks, ADLS, and PySpark, optimizing cloud-based data pipelines and big data solutions.
Data Analyst
Loginworks Software Pvt. Ltd.
03.2020 - 03.2021
Data Processing: Cleaned and structured large-scale unstructured data (Walmart, Amazon web scraping) into high-quality datasets. Analyzed weekly/off-cycle ads using geolocation, pricing, and trend data to deliver actionable insights and boost performance.
SQL & ETL: Developed optimized SQL queries, stored procedures, and high-performance SSIS packages for processing and reporting on complex datasets with accuracy and efficiency.
SSAS & Power BI: Built scalable SSAS Tabular Models integrated with Power BI for advanced analytics and intuitive dashboards.
Data Quality & Visualization: Ensured data accuracy and built compelling Power BI visualizations by optimizing data models and relationships.
Statistical Analysis: Applied statistical methods for business reporting and strategic decision-making.
Education
Master's of Computer Application - Computer Application
GL Bajaj Institute of Technology
Bachelor's of Computer Application - Computer Application
FMG Institute
Senior Secondary - PCM
Maharishi Vidya Mandir
Skills
Azure Ecosystem: Skilled in Azure Data Factory (Linked Services, Triggers, Data Flows, Transformations), Azure Databricks, PySpark, and Spark SQL for big data solutions; experienced with Azure DevOps for Git repositories
SQL Server / Database Management: Advanced T-SQL expertise in stored procedures, functions, indexes, views, and complex joins for optimized database performance
SSIS / SSAS: Proficient in SSIS for ETL (Control Flow, Transformations, Execute SQL Tasks) and SSAS for Tabular Cubes and multidimensional modeling
undefined
Certification
ChatGPT Certification, 05/2024
Personal Information
Timeline
Senior Data Engineer
Xebia
06.2025 - Current
Data Engineer
Assurant Automotive Warranty Solutions
06.2023 - 06.2025
Software Engineer
One97 Communication
10.2021 - 06.2023
Data Analyst
Loginworks Software Pvt. Ltd.
03.2020 - 03.2021
Bachelor's of Computer Application - Computer Application
FMG Institute
Senior Secondary - PCM
Maharishi Vidya Mandir
Master's of Computer Application - Computer Application