Highly skilled data engineer with around 5 years of experience in designing and implementing data solutions. Strong expertise in data integration, ETL processes, and data warehousing. Seeking a challenging role to leverage my technical skills and contribute to data-driven decision-making in a dynamic organization.
Overview
5
5
years of professional experience
Work History
Senior Product Developer ( Azure)
Harman Connected Services
05.2024 - Current
Led end-to-end data migration from on-premise systems (SQL Server, file shares, APIs) to Azure, ensuring seamless data ingestion, minimal downtime, and zero data loss.
Designed and developed scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory (ADF) to ingest, transform, and load data into Azure Data Lake Storage (ADLS Gen2).
Migrated and restructured Master Data Management (MDM) assets into Profisee, enabling centralized governance and seamless integration with cloud-based systems.
Implemented Unity Catalog in Databricks for centralized data governance, fine-grained access control, and auditability across multi-workspace environments.
Worked closely with business and cloud transformation teams to ensure MDM and transactional data accessibility for downstream analytics and reporting.
Automated data pipelines for recurring ingestion jobs from APIs and file shares, improving processing time by 40% and reducing manual intervention.
Designed and optimized data models and partition strategies for high-performance analytics on large datasets within the Azure ecosystem.
Collaborated with data architects, BI teams, and business stakeholders to support enterprise-wide cloud data transformation projects with a focus on data availability, lineage, and scalability.
Senior Application Developer
Tata Consultancy services
02.2021 - 05.2024
Developed shell scripts for data reconciliation and automated data warehouse population using HQL on Hadoop.
Optimized query performance with indexing and partitioning, reducing response time by 30%.
Automated view deployment, cutting manual effort by 70% and improving data validation.
Designed scalable data pipelines for ingesting and transforming large datasets into ADLS Gen2.
Led complex data migrations, ensuring smooth transitions and efficient cloud-based storage.