Summary
Overview
Work History
Education
Websites
Timeline
Generic
Surmita Padhy

Surmita Padhy

Data Engineer
Bengaluru (Bangalore)

Summary

Results-driven Data Engineer with 9+ years of experience in building scalable ETL pipelines, modern data warehouses, and analytics systems. Proficient in Snowflake, PySpark, Spark SQL, Python, and Azure Data Factory (ADF) with hands-on expertise in data modeling, workflow orchestration, and cloud-based data platforms (Azure, AWS). Skilled in Airflow, CI/CD (Azure DevOps, GitHub), and BI tools (Power BI, Tableau) to deliver actionable insights and support high-impact business decisions.

Overview

9
9
years of professional experience

Work History

Data Engineer

ANZ
04.2024 - Current
  • Designed and developed end-to-end ETL pipelines using PySpark, Spark SQL, and Python, processing and transforming large-scale marketing campaign data.
  • Collaborated with marketing teams to define KPIs and deliver actionable insights on campaign performance, improving ROI tracking and decision-making.
  • Integrated data from multiple sources including online ad platforms, CRM systems, and sales databases, ensuring a 360° view of customer engagement.
  • Applied machine learning models to analyze customer behavior patterns and predict campaign success, improving forecasting accuracy.
  • Built dashboards and reporting tools (Power BI/Tableau) to visualize campaign effectiveness and enable data-driven strategy adjustments.
  • Managed and monitored data workflows using Apache Airflow, ensuring 99% on-time delivery of campaign insights.
  • Conducted data discovery and source integration, identifying new datasets to enrich analytics and improve marketing performance insights.

System Analyst

Hexaware Technologies
03.2022 - Current
  • Migrated on-prem SQL Server DW to Azure Synapse and Snowflake, reducing infrastructure costs by 25%.
  • Built PySpark ETL jobs to ingest, transform, and load structured/unstructured data into Snowflake.
  • Designed ADF pipelines for automated ingestion from APIs, flat files, and databases, cutting manual workload by 60%.
  • Implemented CI/CD pipelines in Azure DevOps for automated deployment of data workflows.
  • Collaborated with BI teams to deliver 4+ Power BI dashboards, improving decision-making speed across sales and marketing.

Senior Associate

Acuity Knowledge Partners
09.2021 - 03.2022
  • Responsible for building the code base which would pull data from client database and consolidate them to put it to our internal server, which was done using our Microsoft SQL server.
  • Involved in creation of view which will be referred in the tableau dashboard.
  • Created Tableau dashboard to visualize the factor like carbon emission, pollution ,biodiversity, energy efficiency etc which shows the comparison with standard values setby the ESG governance using interactive filters, parameters and calculations for dashboard and worksheet in tableau which would show how well the company is performing in terms of each parameters.

Senior Analyst – Business Intelligence

Dell International
01.2020 - 09.2021
  • Involved developing cube that is being used for building dashboards in Power Bi.
  • Tableau using best practices of datawarehousing concepts.
    Created Stored Procedure, function to design the backend of the cube fetching.
  • Involved in calculation of metrics that are used for dashboard building.
  • Created optimised APIs for faster data retrieval for Salesworks application.
  • Involved in fixing the bugs and worked on the cube enhancements.

Database Developer

HealthEC India (previously Infotech Global India)
06.2016 - 12.2019
  • Involved in Planning, Analysis, and designing of database to pull data from eCW database through SMTP.
  • Involved in writing complex stored procedures and packages and T-SQL JOIN to extract data into flat file with pipe delimiter and stage table based on the client requirement.
  • Involved in creating Indexes for faster retrieval of data from client system.
  • Maintained data integrity by performing validation checks.
    Involved in running the SQL Profiler for better execution Plans.
  • Involved in moving the flat file and stage table into HEALTHEC client Prod environment.

Education

Bachelor of Technology - Electronics and communication engineering

Biju Patnaik University of Technology
India
06.2014

Websites

Timeline

Data Engineer

ANZ
04.2024 - Current

System Analyst

Hexaware Technologies
03.2022 - Current

Senior Associate

Acuity Knowledge Partners
09.2021 - 03.2022

Senior Analyst – Business Intelligence

Dell International
01.2020 - 09.2021

Database Developer

HealthEC India (previously Infotech Global India)
06.2016 - 12.2019

Bachelor of Technology - Electronics and communication engineering

Biju Patnaik University of Technology

Similar Profiles

CREATE PROFILE
Surmita PadhyData Engineer