Devarshi Tripathi
Lucknow
Summary
Highly motivated Senior Data Engineer with robust background in developing, testing, and maintaining data architectures. Possess strong skills in database management systems, Big Data processing frameworks, data modeling and warehousing. Have successfully led teams in creating innovative data solutions to improve system efficiency and business decision-making processes. Demonstrated impact through enhanced data availability and accuracy in previous roles.
Overview
8
8
years of professional experience
4
4
years of post-secondary education
1
1
Certification
Work History
Senior Data Engineer
Fractal Analytics Pvt. Ltd.
Gurugram
09.2021 - Current
- Integrated Google Analytics data for a home appliances manufacturer and helped it to understand and analyse various user activities and their respective shopping intent.
- Designed Databricks workflow to develop ETL pipelines for the Google Analytics data integration using API.
- Stored the fact and dimensions data in unity catalog as delta tables.
- Designed the star schema data model for consuming these fact and dimensions table in PowerBI for analysis and reporting needs.
- Designed a DQ check framework for above ETL pipelines to look for various quality check parameters like drift, inconsistency etc.
- Designed an E2E data reporting and forecasting framework for a beverages manufacturer, helping them in inventory management for the entire fiscal.
- Optimized the Databricks workflows by using job clusters and other spark technologies.
- Utilized ADF pipelines to integrate data from various sources to the unity catalog.
- Implemented Medallion Architecture to achieve above integration in various layers such sourced, cleansed, presented etc.
- Designed star schema data model with all the facts and dimensions table for reporting in PowerBI.
- Developed a DQ check framework for constant evaluation of various metrics going into the dashboard.
Senior Systems Engineer
Infosys Ltd.
Chandigarh
07.2018 - 08.2021
- Designed automated test scripts using Selenium and Java for software applications.
- Executed regression tests to ensure software functionality before release.
- Collaborated with developers to identify and resolve software defects in code.
- Conducted performance testing to assess application response under various conditions.
- Maintained test documentation and created reports on testing outcomes.
- Participated in Agile ceremonies, contributing to sprint planning and retrospectives.
- Trained junior team members on best practices in automation testing methodologies.
- Developed automated test scripts using Selenium and Java to validate the application's functionality.
Education
Bachelor of Technology - Mechanical Engineering
Ajay Kumar Garg Engineering College
Ghaziabad , India 08.2014 - 06.2018
Skills
- Python
- Advanced SQL
- Pyspark
- Databricks Certified
- Spark
- ETL Design and Implementation
- Data governance
- Azure Cloud Technologies
- Azure Devops
- Agile methodologies
Certification
- AWS Certified Solution Architect Associate
- Databricks Certified Data Engineer Associate.
- Fractal Certified SQL Professional Developer
- Fractal Certified Pyspark Associate Developer
Timeline
Senior Data Engineer
Fractal Analytics Pvt. Ltd.
09.2021 - Current
Senior Systems Engineer
Infosys Ltd.
07.2018 - 08.2021
Bachelor of Technology - Mechanical Engineering
Ajay Kumar Garg Engineering College
08.2014 - 06.2018