Experienced Data Engineer with 7 years in AWS, Big Data, and ETL development, specializing in data exploration, processing, and pipeline optimization. Skilled in PySpark, SQL, PLSQL, Informatica, Databricks, and AWS Cloud, with expertise in data migration, storage, and performance tuning. Adept at designing scalable ETL workflows, ensuring data quality and integrity, and resolving complex data issues across multi-platform environments. Strong problem-solving abilities with a focus on collaboration and innovation, driving efficient data-driven decision-making. Passionate about cloud computing and data engineering, continuously learning to build high-performance data solutions.
Project: Campaign Migration – IDFC First Bank
Project 1: Data Process Optimization – Axis Bank Bharat Bank
Optimized Data Processes: Improved data transfer efficiency for Agri, MSME, and rural markets.
SQL Development: Created 50+ complex SQL queries to support business analytics and reporting.
Streamlined Analytics: Designed parametric procedures, reducing processing time.
Performance Tuning: Resolved data issues, significantly improving query execution time.
Enhanced Cross-Selling: Leveraged DataMart to improve product targeting and sales strategies.
Project 2: Centralized Star Schema Data Mart
Data Mart Consolidation: Merged 4 legacy Data Marts into a centralized structure using Kimball's Star Schema in Azure Data Factory.
Optimized Data Integration: Integrated 5 dimension tables and 3 fact tables for seamless data processing.
Performance Improvement: Reduced processing time through efficient ETL design and automation.
Enhanced Query Performance: Implemented indexing and partitioning, improving data retrieval speeds.
Business Impact: Enabled faster and more efficient reporting, empowering analytics and data science teams.
Project: Enterprise Data Warehouse Development – Equity Insurance Ltd