ABHINAV
Data Engineer
Gurgaon
Summary
Experienced Data Engineer with expertise in ETL development, big data technologies, and real-time data processing. Skilled in Azure Databricks, Azure Data Factory, Azure Synapse Analytics and optimizing data workflows. Proven ability to enhance data processing efficiency and deliver actionable insights.
Overview
4
4
years of post-secondary education
2
2
Certifications
Work History
Senior Associate Data Engineer
Publicis Sapient
03.2024 - Current
- Implemented in-memory processing using Apache Spark to improve the performance of big data analytical applications in Azure Synapse Analytics.
- Built and managed ETL pipelines in Azure, leveraging Azure Synapse Analytics, Azure Storage, and Azure Synapse Spark pool.
- Developed and optimized Delta Live Tables pipeline in Azure Databricks for processing streaming and batch data from various sources.
- Utilized real-time analytics to provide immediate insights, enabling rapid business decisions and opportunities.
Data Engineer
Fractal Analytics
6 2021 - 08.2023
- Designed, developed, and implemented PySpark scripts for efficient data processing, transformation, and analysis
- Built robust ETL pipelines using PySpark to extract, transform, and load data from various sources for analysis
- Conducted performance tuning and optimization of PySpark jobs to enhance data processing speed and efficiency
- Developed Hive queries for efficient data loading and processing in Hadoop
- Leveraged Azure ADLS and Data Factory for seamless data integration and transformation.
- Recognized for optimizing data processing workflows, reducing processing time by 30%.
Associate Business Intelligence Analyst
Gen Digital (Formerly Known As Norton LifeLock)
1 2019 - 5 2020
- Enhanced SQL development and Informatica workflows for streamlined data processing.
- Assisted in web scraping tasks using Python, supporting the team in extracting relevant data from web sources.
- Implemented data validation and quality checks to maintain data integrity across different systems.
- Automated data workflows using Python and PySpark, enhancing operational efficiency and reducing manual efforts.
- Contributed to a 20% improvement in data processing efficiency through optimization and automation initiatives.
Education
B. Tech - Computer Science Engineering
SRM Institute of Science & Technology
Vadapalani, Tamil Nadu 04.2015 - 04.2019
Skills
Big Data Technologies : Hive, Hadoop
Language & Framework: Python, PySpark
Databases: PostgreSQL, SQL Server, Mongo DB
Cloud Services: Databricks, Azure Data Factory, Azure Synapse, Azure SQL Database
Data Visualization : Power BI
Certification
Databricks Lakehouse Fundamentals
Timeline
Senior Associate Data Engineer
Publicis Sapient
03.2024 - Current
Databricks Lakehouse Fundamentals
05-2023
Microsoft Certified: Azure Data Engineer Associate (DP-203)
08-2021
B. Tech - Computer Science Engineering
SRM Institute of Science & Technology
04.2015 - 04.2019
Data Engineer
Fractal Analytics
6 2021 - 08.2023
Associate Business Intelligence Analyst
Gen Digital (Formerly Known As Norton LifeLock)
1 2019 - 5 2020
Similar Profiles
MODINAT OLUTUNDEMODINAT OLUTUNDE
Agile Project Manager at Publicis SapientAgile Project Manager at Publicis Sapient
AMIT GUPTAAMIT GUPTA
Senior Manager - Agile Program Management at Publicis SapientSenior Manager - Agile Program Management at Publicis Sapient
Sugandha RajSugandha Raj
Product Owner at Publicis SapientProduct Owner at Publicis Sapient
Tushar KaushikTushar Kaushik
Specialist Infrastructure at Publicis Sapient Groupe LtdSpecialist Infrastructure at Publicis Sapient Groupe Ltd
Smriti RanaSmriti Rana
Technical Architect & Lead at Builder.aiTechnical Architect & Lead at Builder.ai