Rajeev Upadhyay
Pune
Summary
Senior Data Engineer with 8+ years of experience building scalable data platforms, distributed data pipelines, and enterprise-grade data infrastructure. Currently working at Red Hat, focusing on designing and operating robust ETL/ELT systems that support large-scale data and AI-driven use cases.
Expertise in developing pipelines using Python, SQL, and PySpark, along with modern data stack tools such as Snowflake, Databricks, and Starburst/Trino. Strong experience in implementing Medallion Architecture (Raw, Silver, Gold layers) to enable reliable, scalable, and well-governed data processing.
Proficient in data quality frameworks, data governance, and secure data handling including PII adherence.Experienced in building production-grade data systems with CI/CD pipelines using GitLab, ensuring reliability, observability, and performance of data workflows.
Overview
9
9
years of professional experience
2
2
Certifications
Work History
Senior Data Analyst
RedHat India Pvt Ltd
Pune
05.2024 - Current
- Leveraged DBT, Snowflake, Python, and Starburst, Databricks, SQL to transform raw data, implement semantic modeling, and optimize data reliability.
- Performed metadata testing for the Starburst → Snowflake migration, including validation of masked fields, schema consistency, and data completeness.
- Design and develop scalable ETL/ELT pipelines using Python, SQL, and PySpark for large-scale data processing
- Implement Medallion Architecture (Raw, Silver, Gold layers) to structure and transform data across multiple stages
- Ensure high data quality through validation frameworks, applying masking, monitoring, and automated checks
- Implement data governance practices including PII handling, access control, and compliance standards
- Develop and maintain CI/CD pipelines using GitLab for automated deployment and version control
- Enable reliable and efficient data pipelines supporting analytics and AI/ML use cases
- Automated end-to-end data workflows using GitLab CI/CD, reducing manual intervention and improving pipeline efficiency for analytics-ready datasets.
Senior BI Analyst
SolarWinds
Remote
11.2023 - 05.2024
- Developed robust SQL scripts to extract relevant information from large datasets quickly and accurately, expediting ad hoc report requests.
- Consumed Apptio Cloudability APIs to build Cloud Spend Analytics, including end-to-end ETL, SCD Type-2 logic, and GitLab-scheduled jobs.
- Led a team of BI analysts in creating intuitive dashboards and reports that improved decision-making processes for senior management.
Business Intelligence Engineer
RedHat
Pune
02.2021 - 06.2023
- Statistical Bookings Forecast Project: Tableau dashboarding to show the key parameters in the dashboard including forecast numbers, Actuals numbers, historical data and Manager's judgment number in the dashboard.
- Used Time-series forecasting models to predict the Bookings numbers for rolling 4 quarters and compared this with targets for the quarter as well as Manger's judgement number for the quarter.
- Skills: Python, SQL, Tableau, Time-series forecasting, stakeholder management, Project management, finance
- Data quality assurance
System Engineer
Infosys Limited
Pune
05.2018 - 02.2021
- Reports generation using data visualization concept (tableau/R/python).
- Using IBM data-stage as an ETL tool to automate the ETL testing reports by 60%.
- Managed multiple projects simultaneously, meeting tight deadlines while maintaining high-quality deliverables.
Analyst
eClerx Services Limited
Pune
04.2017 - 05.2018
- Skills Required: Data Reconciliation, Advanced excel, database knowledge using SQL, Time saving through automation by 40%.
Education
Advanced Management Program - Business Analytics
Indian School of Business
Hyderabad01.2022
Bachelor of Engineering -
D.Y. PATIL COLLEGE OF ENGINEERING
Akurdi, Pune01.2016
H.S.C - C.B.S.E
Oxford Public School
Ranchi05.2012
S.S.C - CBSE Board
BNS DAV Public School
Giridih05.2010
Skills
- Python
- SQL
- Databricks
- Tableau Suite
- DBT
- Snowflake
- Starburst
- Gitlab CI/CD
- Cloud-based storage solutions
- Miro Board
- Confluence
- Microsoft Excel
- AWS services
- Data quality assurance
- Metadata validation
- SCD implementations
- Team Leadership
- Data Warehousing
Languages
English
Social networks
www.linkedin.com/in/rajeev-upadhyay-0487a8104
Certification
AMPBA from ISB Hyderabad
Timeline
Senior Data Analyst
RedHat India Pvt Ltd
05.2024 - Current
Senior BI Analyst
SolarWinds
11.2023 - 05.2024
Business Intelligence Engineer
RedHat
02.2021 - 06.2023
System Engineer
Infosys Limited
05.2018 - 02.2021
Analyst
eClerx Services Limited
04.2017 - 05.2018
Advanced Management Program - Business Analytics
Indian School of Business
Bachelor of Engineering -
D.Y. PATIL COLLEGE OF ENGINEERING
H.S.C - C.B.S.E
Oxford Public School
S.S.C - CBSE Board
BNS DAV Public School