Jagpreet Kaur
Bengaluru
Summary
Passionate recent graduate specializing in data engineering. Proficient in leveraging advanced analytics techniques to extract actionable insights from datasets. Eager to leverage academic knowledge and hands-on experience to contribute effectively to data-driven projects.
Overview
2
2
years of professional experience
1
1
Certification
Work History
Data Engineer
Fractal analytics
Bengaluru
10.2023 - Current
- Migrated complex Synapse stored procedures to Pyspark/Spark SQL in Databricks, optimizing data workflows and performance.
- Scheduled Databricks pipelines for seamless data operations.
- Validated data with stakeholders ensuring accuracy and reliability.
Data Engineer
Fractal analytics
Bengaluru
10.2023 - Current
- Designed and implemented a scalable data pipeline on Azure, focusing on efficient data processing and visualization.
- Used PySpark to develop validation framework.
- Created serverless function apps for reading config files and posting data to Redis Cache.
- Created Data factory pipelines to load and transform data after the validation is successful.
- Designed and implemented scalable data pipeline focusing on efficient data ingestion, processing, and validation.
- Worked for an automobile client where we processed and converted terabytes of data into ORC and Parquet file format.
- Conducted data quality checks and ensured adherence to best practices for data governance on both Azure and AWS platforms.
- Actively contributed to the design and development of ETL jobs, ensuring seamless data flow and integration across systems.
- Implemented ETL processes using tools like Apache Spark and SQL.
- Analyzed data quality and resolved discrepancies in datasets.
- Maintained documentation for data workflows and procedures.
Education
Bachelor of Technology - Electronics & Communications Engineering
Banasthali Vidyapith
Skills
- Azure Data Factory
- Azure Databricks
- Az Function Apps
- Ms excel
- SQL
- Pyspark
- Spark SQL
- Data validation framework
- Effective communication
- Problem solving
- Real-time analytics
- Data migration
- SQL programming
Certification
- Azure Capstone Project, DP203 certification
- DP-900, Microsoft Azure Data Fundamentals
Role
Engineer
Languages
English, Hindi, Punjabi
First Language
Timeline
Data Engineer
Fractal analytics
10.2023 - Current
Data Engineer
Fractal analytics
10.2023 - Current
Bachelor of Technology - Electronics & Communications Engineering
Banasthali Vidyapith