Paawan Chowhan
Udaipur
Summary
Experienced Data Engineer Lead with a robust background in building scalable data pipelines, real-time data processing, and cloud-based big data architecture. Proficient in modern data platforms including Azure and Databricks with a track record of optimizing data workflows and leading high-performing teams.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Data Engineer (Lead)
Tiger Analytics
06.2021 - Current
- Lead design and development of scalable data pipelines for large-scale enterprise datasets.
- Architected end-to-end data workflows using Azure Databricks, Azure Datafactory, Azure sql, Azure Data Lake and Logic Apps.
- Mentored and managed a team of data engineers performing code reviews to adhere to client coding standards and Data Engineering best practices.
- Spearheaded migration of resources from one RG to another using Azure Devops Pipelines.
- Collaborating with cross functional teams and clients to gather requirements, perform data analysis, signoff on KPI calculations and deliver solutions.
- Hands on experience with Medallion and Data mesh architectures for modern data platform design.
Data Engineer
Amdocs
Pune
07.2018 - 06.2021
- Company Overview: Pune
- Developed and maintained consolidated data warehouses and ETL processes.
- Built optimal data pipelines to manage large, complex datasets.
- Implemented near real-time data ingestion with Kafka and GoldenGate.
- Worked with JSON data and automated transformations for Vertica ingestion.
- Collaborated with cross-functional teams for performance tuning and delivery.
- Pune
Education
Bachelor of Computer Science -
Geetanjali Institute of Technical Studies
01.2018
CBSE 12th -
St. Gregorios Sr. Sec. School
01.2014
CBSE 10th -
St. Gregorios Sr. Sec. School
01.2012
Skills
- Python
- Azure Sql
- Oracle
- Teradata
- Vertica
- CosmosDB
- Hadoop
- Spark
- HDFS
- Hive
- Sqoop
- Azure Data Factory
Certification
- Databricks Certified Data Engineer Professional
- Microsoft Certified: Azure Cosmos DB Developer Specialty
- Microsoft Certified: Azure Data Engineer Associate
Projects
Twitter Hashtag Analyzer: Real-time trend analyzer using PySpark and Twitter API. ORC to DAT Converter: Automated ORC file conversion pipeline reducing manual effort by 90%. Placement Guru: NodeJS-based MCQ and coding test platform. Weather Visualizer: Web app for visual weather reporting using Fetch API. Project Status Tracker: Internal project tracking portal using NodeJS.
Affiliations
- Been recognized as key player by clients (product manager, Senior Data Engineering manager)and VP of Analytics Consulting.
Timeline
Data Engineer (Lead)
Tiger Analytics
06.2021 - Current
Data Engineer
Amdocs
07.2018 - 06.2021
Bachelor of Computer Science -
Geetanjali Institute of Technical Studies
CBSE 12th -
St. Gregorios Sr. Sec. School
CBSE 10th -
St. Gregorios Sr. Sec. School