Summary
Overview
Work History
Education
Skills
Certification
Awards
Websites
Timeline
Generic
ARPIT TRIVEDI

ARPIT TRIVEDI

Summary

Experienced Data Platform & Solution Architect with a background in Computer Science and Engineering. Proficient in data modeling, ETL processes, and SQL with expertise in architecture, team leadership, and various ETL tools. Skilled in big data technologies, cloud platforms, and infrastructure. Seeking a role as a Data Architect to leverage my diverse skill set and drive successful data projects.

Overview

10
10
years of professional experience
1
1
Certification

Work History

Data Platform & Solution Architect

Physics Wallah
Noida
07.2023 - Current
  • Architected a central data platform using Medallion Architecture (Bronze, Silver, Gold) for scalable data processing.
  • Built a scalable data ingestion framework using JDBC, Debezium, Kafka, and Spark (batch and real-time), reducing latency by 40%, achieving 99.9% uptime, and enabling real-time reporting for more than 5 business units.
  • Optimized analytics infrastructure by implementing Trino with Iceberg on S3 and dbt, cutting BigQuery query costs by 85% monthly.
  • Led cross-functional data teams (ETL and platform, 15+ engineers) to drive architecture, governance, and scalable, high-performance data pipelines, delivering measurable business impact.

Senior Principal Engineer

Bharti Airtel (Wynk)
Gurugram
02.2022 - 06.2023
  • Built a scalable user feature store using Spark, powering real-time, personalized song recommendations for 50M+ users, and actively leveraged by the Data Science team.
  • Led data warehouse modernization (Redshift, BigQuery) to enhance reporting and decision-making.
  • Led the implementation of GDPR-compliant data governance and IAM controls, and developed audit pipelines with Deequ and Great Expectations, reducing data loss by 30% and enabling proactive alerts for quality anomalies across critical systems.
  • Collaborated with engineering, product, and analytics teams to drive data-driven strategies and innovation.
  • Generated engineering documentation and oversaw design projects.

Lead Data Engineer

Paytm (One97 Communication)
05.2018 - 02.2022
  • Led data platform migration from in-house to AWS Cloud, migrating 100+ TB of data to Glacier and 300+ ETL jobs to the new platform.
  • Built and led a 10-member team (DAAS & Platform), optimizing OLAPs, data models, and ensuring a scalable, production-grade platform.
  • Designed HLDs & LLDs for system performance, Apache Atlas (Lineage), GDS, logging, schema generation, and volumetric analysis.

System Engineer / Data Engineer

Tata Consultancy Services
12.2015 - 05.2018
  • Developed Big Data pipelines for clients, enabling scalable feature creation and analytics.
  • Created Hive tables to manage structured data from UNIX, Oracle, and multiple portfolios, optimizing storage and retrieval.
  • Built BI reports using multi-threaded Sqoop, exporting data to HDFS and Hive for analysis.

Education

B.Tech - Computer Science and Engineering

Jaypee Institute of Information And Technology
Noida, India
07-2015

Senior Secondary Education -

Sir Padampat Singhania Education Center
Kanpur, India
03-2010

High School Education -

B.N.S.D. Siksha Niketan Inter College
Kanpur, India
03-2008

Skills

  • Data modeling: OLTP, OLAP, star/snowflake, medallion architecture
  • SQL proficiency (advanced query tuning, window functions)
  • System design: HLD, LLD, documentation, SOLID principles
  • ETL tools: Airflow, dbt, Kafka, Apache Spark, Kafka Streams, Spark Structured Streaming
  • Near real-time dashboards and alerting
  • Big data: Lake house, warehouse systems
  • Big data tools: Apache Spark, Hadoop, Hive
  • Lakehouse architectures: Redshift, Trino, Delta Lake, S3
  • AWS: Kubernetes, S3, EMR, Redshift, Glue
  • GCP: BigQuery
  • RDBMS: Oracle, MySQL, PostgreSQL
  • NoSQL: MongoDB
  • API management: FastAPI/Swagger, secure gateway design, and microservices
  • Team leadership and mentoring: 15 or more data engineers
  • Agile/Scrum delivery: PSM certified
  • Cross-functional collaboration

Certification

  • AWS Certified Solutions Architect - Professional — 2025-01
  • Oracle Certified Professional, Java SE 6 — August 2014
  • Professional Scrum Master (PSM) — 2023-01

Awards

RockStar Award — 2023, Physics Wallah, Hall of Fame — 2020, Paytm, Best Innovator — 2017, TCS

Timeline

Data Platform & Solution Architect

Physics Wallah
07.2023 - Current

Senior Principal Engineer

Bharti Airtel (Wynk)
02.2022 - 06.2023

Lead Data Engineer

Paytm (One97 Communication)
05.2018 - 02.2022

System Engineer / Data Engineer

Tata Consultancy Services
12.2015 - 05.2018

B.Tech - Computer Science and Engineering

Jaypee Institute of Information And Technology

Senior Secondary Education -

Sir Padampat Singhania Education Center

High School Education -

B.N.S.D. Siksha Niketan Inter College
ARPIT TRIVEDI