Surmita Padhy
Data Engineer
Bengaluru (Bangalore)
Summary
Results-driven Data Engineer with 9+ years of experience in building scalable ETL pipelines, modern data warehouses, and analytics systems. Proficient in Snowflake, PySpark, Spark SQL, Python, and Azure Data Factory (ADF) with hands-on expertise in data modeling, workflow orchestration, and cloud-based data platforms (Azure, AWS). Skilled in Airflow, CI/CD (Azure DevOps, GitHub), and BI tools (Power BI, Tableau) to deliver actionable insights and support high-impact business decisions.
Overview
9
9
years of professional experience
Work History
Data Engineer
ANZ
04.2024 - Current
- Designed and developed end-to-end ETL pipelines using PySpark, Spark SQL, and Python, processing and transforming large-scale marketing campaign data.
- Collaborated with marketing teams to define KPIs and deliver actionable insights on campaign performance, improving ROI tracking and decision-making.
- Integrated data from multiple sources including online ad platforms, CRM systems, and sales databases, ensuring a 360° view of customer engagement.
- Applied machine learning models to analyze customer behavior patterns and predict campaign success, improving forecasting accuracy.
- Built dashboards and reporting tools (Power BI/Tableau) to visualize campaign effectiveness and enable data-driven strategy adjustments.
- Managed and monitored data workflows using Apache Airflow, ensuring 99% on-time delivery of campaign insights.
- Conducted data discovery and source integration, identifying new datasets to enrich analytics and improve marketing performance insights.
System Analyst
Hexaware Technologies
03.2022 - Current
- Migrated on-prem SQL Server DW to Azure Synapse and Snowflake, reducing infrastructure costs by 25%.
- Built PySpark ETL jobs to ingest, transform, and load structured/unstructured data into Snowflake.
- Designed ADF pipelines for automated ingestion from APIs, flat files, and databases, cutting manual workload by 60%.
- Implemented CI/CD pipelines in Azure DevOps for automated deployment of data workflows.
- Collaborated with BI teams to deliver 4+ Power BI dashboards, improving decision-making speed across sales and marketing.
Senior Associate
Acuity Knowledge Partners
09.2021 - 03.2022
- Responsible for building the code base which would pull data from client database and consolidate them to put it to our internal server, which was done using our Microsoft SQL server.
- Involved in creation of view which will be referred in the tableau dashboard.
- Created Tableau dashboard to visualize the factor like carbon emission, pollution ,biodiversity, energy efficiency etc which shows the comparison with standard values setby the ESG governance using interactive filters, parameters and calculations for dashboard and worksheet in tableau which would show how well the company is performing in terms of each parameters.
Senior Analyst – Business Intelligence
Dell International
01.2020 - 09.2021
- Involved developing cube that is being used for building dashboards in Power Bi.
- Tableau using best practices of datawarehousing concepts.
Created Stored Procedure, function to design the backend of the cube fetching. - Involved in calculation of metrics that are used for dashboard building.
- Created optimised APIs for faster data retrieval for Salesworks application.
- Involved in fixing the bugs and worked on the cube enhancements.
Database Developer
HealthEC India (previously Infotech Global India)
06.2016 - 12.2019
- Involved in Planning, Analysis, and designing of database to pull data from eCW database through SMTP.
- Involved in writing complex stored procedures and packages and T-SQL JOIN to extract data into flat file with pipe delimiter and stage table based on the client requirement.
- Involved in creating Indexes for faster retrieval of data from client system.
- Maintained data integrity by performing validation checks.
Involved in running the SQL Profiler for better execution Plans. - Involved in moving the flat file and stage table into HEALTHEC client Prod environment.
Education
Bachelor of Technology - Electronics and communication engineering
Biju Patnaik University of Technology
India06.2014
Timeline
Data Engineer
ANZ
04.2024 - Current
System Analyst
Hexaware Technologies
03.2022 - Current
Senior Associate
Acuity Knowledge Partners
09.2021 - 03.2022
Senior Analyst – Business Intelligence
Dell International
01.2020 - 09.2021
Database Developer
HealthEC India (previously Infotech Global India)
06.2016 - 12.2019
Bachelor of Technology - Electronics and communication engineering
Biju Patnaik University of Technology