Rajat Shukla
Manager - Data Engineering
Lucknow
Summary
Proven data engineering lead with strong delivery ownership and hands-on experience using Databricks (PySpark/Spark SQL), Delta Lake, and Azure-based pipelines to build scalable, modern data solutions. Known for leading teams, driving structure in complex projects, and ensuring high-quality delivery in fastpaced environments. Alongside cloud data engineering, also experienced in Qlik Sense, data modeling, ETL design, and enterprise BI delivery, enabling analytics across global business teams. Experienced in combining Databricks-driven data pipelines with Qlik/Power BI reporting layers to deliver scalable and governed enterprise analytics.
Overview
9
9
years of professional experience
6
6
years of post-secondary education
2
2
Certifications
Work History
Manager - Data Engineering Qlik
Aptia Group
03.2024 - Current
- Worked with the cloud engineering team to modernize parts of the BI pipeline using Azure Data Factory and Databricks notebooks, enabling faster and scalable data transformations.
- Designed Bronze → Silver → Gold Delta Lake layers for Qlik reporting datasets to reduce dependency on heavy QVD transformations.
- Built PySpark-based transformation logic to cleanse, validate and standardize datasets before loading into Qlik models.
Implemented incremental data refresh logic using Delta Lake MERGE and optimized Spark SQL queries to reduce pipeline runtime. - Collaborated with platform teams to connect curated Delta tables into Qlik Sense via Azure SQL / Synapse.
- Improved reliability of BI loads by shifting complex data massaging steps from Qlik script to Databricks notebooks.
- Spearheaded the complete end-to-end migration of Qlik Sense apps from Mercer to Aptia, including architecture, access setup, automation, and stakeholder coordination.
- Designed and developed optimized data models for efficient Qlik Sense applications , created interactive dashboards and visualizations to provide actionable insights.
Senior Principal Engineer - Data Engineering
Mercer
Gurgaon
07.2022 - 02.2024
- Earned 2 Qlik certifications—Business Analyst and Administrator—while actively delivering in a high-paced environment.
- Contributed to Mercer's cloud modernization initiative by shifting legacy Qlik data preparation steps to Databricks-based ETL, improving data quality, and reducing reload failures.
- Built and scheduled ADF pipelines for ingesting data from SQL Server, SFTP, and API sources into ADLS Gen2.
- Developed reusable Databricks notebooks using PySpark for data
transformation, joins, aggregation, and exception-handling frameworks. - Implemented Delta Lake schema enforcement and validation for smoother downstream use in Qlik and Power BI dashboards.
- Performed SQL tuning and Spark optimization using partitioning, broadcast joins, and caching for faster data readiness.
- Enabled Qlik developers with pre-cleaned, curated datasets, reducing Qlik script complexity, and improving dashboard performance.
Module Lead - Qlik
Sopra Steria
Noida
06.2021 - 07.2022
- Led a 7-member Qlik team, overseeing module-level planning, development, and delivery.
- Governed a team of BI consultants for implementing BI solutions for direct clients; interacted with clients to gather business requirements and drafted SRS and BRD documents.
- Developed project plan, delivery roadmap, test strategy, and managed successful go-live phases.
- Participated in capacity planning, effort estimation, and staffing discussions for BI delivery.
Lead Consultant - BI
Icon Resources and Technologies
Noida
01.2018 - 06.2021
- Led a 7-member BI team, managing end-to-end Qlik Sense project delivery.
- Interfaced with clients to translate business needs into scalable dashboards.
- Mentored juniors on Qlik development and data modeling best practices.
- Standardized delivery through reusable data models and governance setups.
Qlik Developer
Enhanced Software Solutions Pvt. Ltd.
Mumbai
05.2017 - 12.2017
- Built foundational Qlik Sense dashboards involving data extraction, transformation, and front-end visualizations.
- Gained strong grounding in QVD creation, set analysis, and best practices in data modeling.
Education
MBA - Information Technology And System Management
Narsee Monjee Institute of Management Studies (NMIMS)
07.2022 - 06.2024
B.Tech With Honours - Computer Science
GLA University
08.2013 - 05.2017
Skills
Certification
Qlik Certified Administrator, 10/01/20
Timeline
Manager - Data Engineering Qlik
Aptia Group
03.2024 - Current
MBA - Information Technology And System Management
Narsee Monjee Institute of Management Studies (NMIMS)
07.2022 - 06.2024
Senior Principal Engineer - Data Engineering
Mercer
07.2022 - 02.2024
Module Lead - Qlik
Sopra Steria
06.2021 - 07.2022
Lead Consultant - BI
Icon Resources and Technologies
01.2018 - 06.2021
Qlik Developer
Enhanced Software Solutions Pvt. Ltd.
05.2017 - 12.2017
B.Tech With Honours - Computer Science
GLA University
08.2013 - 05.2017