Detail-oriented and outcome driven Data engineer with 2 years of hands-on experience in SQL, ETL processes, and data
visualization. Proficient in leveraging tools such as Azure Data Factory, Databricks, PySpark, SQL and Python to manage and analyse large datasets efficiently. Adept at designing and executing complex SQL queries to uncover insights, improve data quality, and support business decision-making.
Hi, I’m
Mridul Trivedi
Gurgaon,HR
Summary
Overview
2
years of professional experience
Work History
Amdocs
Technology Integration Engineer
03.2024 - Current
Job overview
- At Amdocs, I have been responsible for designing and managing end-to-end data pipelines using Azure Data Factory, Databricks, and PySpark to process large-scale structured and semi-structured datasets from multiple sources
- Implemented a robust error-logging and monitoring framework, improving the debugging process and system reliability
- My role included building optimized SQL queries and transformations to standardize enterprise data, which was then stored and managed in Azure Data Lake and Synapse Analytics for advanced reporting and analytics
- I also worked on data modeling and storage in Azure Synapse, enabling high-performance querying for analytics use cases. Furthermore, I collaborated with the analytics team by creating Power BI reports and dashboards, turning raw data into actionable insights that supported operational and strategic initiatives
Dahua Technology
Data Engineer
11.2023 - 03.2024
Job overview
- Developed and deployed a comprehensive data analysis pipeline for Dahua’s internal product sales data. Utilized Databricks and
PySpark to perform ETL processes on large-scale sales datasets. - Worked for an internal project to analyze our product sales data. Spearheaded end-to-end ETL processes, acquiring and
transforming data. - Utilized AWS S3 for storage and data retrieval into ADF, establishing seamless integration between the two platforms.
- Performed & wrote scripts within Databricks for data processing and transformation using Apache Spark.
Education
Amity University Noida, India
Bachelor of Technology from Computer Science And Engineering
07-2023
University Overview
Skills
- ETL development
- Azure - Azure Data Factory
- PySpark
- Python
- SQL
- NoSQL
- Databricks
- Data curating
- Data migration
Timeline
Technology Integration Engineer
Amdocs
03.2024 - Current
Data Engineer
Dahua Technology
11.2023 - 03.2024
Amity University
Bachelor of Technology from Computer Science And Engineering