Darshan M
Bengaluru
Summary
Data Engineer with 10+ years of experience designing and implementing enterprise data warehouses, cloud-native data platforms, and modern data ecosystems across AWS, Azure, Databricks, and Snowflake. Expertise in data architecture, data warehousing, ETL/ELT pipeline development, and dimensional modelling using Star Schema, Snowflake Schema, and Data Vault. Proficient in building scalable, high-performance data solutions using SQL, PySpark, dbt, Airflow, AWS Glue, Redshift, and Power BI to support enterprise reporting, business intelligence, and advanced analytics. Strong experience in data governance, data quality, cloud migration, query optimization, and performance tuning, with a proven track record of delivering end-to-end data engineering solutions for large-scale enterprise environments.
Overview
10
10
years of professional experience
Work History
Senior Data Engineer / Data Architect
Deloitte Consulting India Pvt. Ltd.
Bengaluru
09.2021 - Current
- Architected and deployed end-to-end data pipelines using Databricks, dbt, and ETL frameworks, enabling scalable and reliable data processing across enterprise platforms.
- Designed and implemented data warehousing solutions, improving data integration from diverse sources for enhanced analytical reporting.
- Developed high-performance ETL/ELT pipelines using PySpark, SQL, and dbt in Databricks, enabling scalable data transformation, optimization, and analytics-ready datasets.
- Implemented incremental and CDC-based data ingestion from on-premises and cloud source systems, enhancing data synchronization reliability across diverse environments.
- Designed and implemented Star Schema, Snowflake Schema, and Data Vault data models to support enterprise analytics and operational reporting.
- Collaborated with business and technical stakeholders to translate complex requirements into scalable data architecture and analytics solutions, driving alignment between technical capabilities and business needs.
- Optimised ETL workflows and query performance, significantly improving data processing efficiency and reducing execution time for enterprise reporting.
Data Engineer / Data Analyst
Algonomy Software
Bengaluru
01.2019 - 09.2021
- Designed and implemented scalable data models and ETL frameworks in AWS Redshift to support enterprise retail analytics.
- Developed fact tables, dimensional models (Star Schema), and aggregate tables, enhancing reporting performance and query efficiency.
- Built and optimised SSIS packages for automated data ingestion, transformation, and integration across multiple retail source systems, streamlining data processes.
- Automated data movement and orchestration using AWS S3 and AWS Glue, enabling reliable and efficient ETL workflows.
- Implemented data validation and reconciliation frameworks to ensure high data quality, integrity, and consistency across pipelines.
- Collaborated with business stakeholders to translate reporting requirements into KPI-driven analytics solutions and dashboards, ensuring alignment with business objectives.
Data Engineer / Data Analyst
Tesco Technologies
Bengaluru
11.2016 - 01.2019
- Designed relational database schemas and created optimized stored procedures.
- Developed ETL workflows using SSIS for operational and analytical data flows.
- Implemented data quality and reconciliation processes across systems.
- Performed SQL performance tuning and index optimization for large datasets.
- Supported data integration with reporting systems and business dashboards.
- Designed relational database schemas and created optimized stored procedures.
Education
Bachelor of Science - computer science
Visvesvaraya Technological University
Belagavi, IN-KA01-2014
Skills
- Data Engineering
- Data Architecture
- ETL/ELT Development
- Data Warehousing
- Data Modelling
- Data Vault Modelling
- SQL
- Dbt (Build Data tool)
- AWS Redshift
- Databricks
- PySpark
- AWS services
Timeline
Senior Data Engineer / Data Architect
Deloitte Consulting India Pvt. Ltd.
09.2021 - Current
Data Engineer / Data Analyst
Algonomy Software
01.2019 - 09.2021
Data Engineer / Data Analyst
Tesco Technologies
11.2016 - 01.2019
Bachelor of Science - computer science
Visvesvaraya Technological University