ARPIT TRIVEDI
Summary
Experienced Data Platform & Solution Architect with a background in Computer Science and Engineering. Proficient in data modeling, ETL processes, and SQL with expertise in architecture, team leadership, and various ETL tools. Skilled in big data technologies, cloud platforms, and infrastructure. Seeking a role as a Data Architect to leverage my diverse skill set and drive successful data projects.
Overview
10
10
years of professional experience
1
1
Certification
Work History
Data Platform & Solution Architect
Physics Wallah
Noida
07.2023 - Current
- Architected a central data platform using Medallion Architecture (Bronze, Silver, Gold) for scalable data processing.
- Built a scalable data ingestion framework using JDBC, Debezium, Kafka, and Spark (batch and real-time), reducing latency by 40%, achieving 99.9% uptime, and enabling real-time reporting for more than 5 business units.
- Optimized analytics infrastructure by implementing Trino with Iceberg on S3 and dbt, cutting BigQuery query costs by 85% monthly.
- Led cross-functional data teams (ETL and platform, 15+ engineers) to drive architecture, governance, and scalable, high-performance data pipelines, delivering measurable business impact.
Senior Principal Engineer
Bharti Airtel (Wynk)
Gurugram
02.2022 - 06.2023
- Built a scalable user feature store using Spark, powering real-time, personalized song recommendations for 50M+ users, and actively leveraged by the Data Science team.
- Led data warehouse modernization (Redshift, BigQuery) to enhance reporting and decision-making.
- Led the implementation of GDPR-compliant data governance and IAM controls, and developed audit pipelines with Deequ and Great Expectations, reducing data loss by 30% and enabling proactive alerts for quality anomalies across critical systems.
- Collaborated with engineering, product, and analytics teams to drive data-driven strategies and innovation.
- Generated engineering documentation and oversaw design projects.
Lead Data Engineer
Paytm (One97 Communication)
05.2018 - 02.2022
- Led data platform migration from in-house to AWS Cloud, migrating 100+ TB of data to Glacier and 300+ ETL jobs to the new platform.
- Built and led a 10-member team (DAAS & Platform), optimizing OLAPs, data models, and ensuring a scalable, production-grade platform.
- Designed HLDs & LLDs for system performance, Apache Atlas (Lineage), GDS, logging, schema generation, and volumetric analysis.
System Engineer / Data Engineer
Tata Consultancy Services
12.2015 - 05.2018
- Developed Big Data pipelines for clients, enabling scalable feature creation and analytics.
- Created Hive tables to manage structured data from UNIX, Oracle, and multiple portfolios, optimizing storage and retrieval.
- Built BI reports using multi-threaded Sqoop, exporting data to HDFS and Hive for analysis.
Education
B.Tech - Computer Science and Engineering
Jaypee Institute of Information And Technology
Noida, India07-2015
Senior Secondary Education -
Sir Padampat Singhania Education Center
Kanpur, India03-2010
High School Education -
B.N.S.D. Siksha Niketan Inter College
Kanpur, India03-2008
Skills
- Data modeling: OLTP, OLAP, star/snowflake, medallion architecture
- SQL proficiency (advanced query tuning, window functions)
- System design: HLD, LLD, documentation, SOLID principles
- ETL tools: Airflow, dbt, Kafka, Apache Spark, Kafka Streams, Spark Structured Streaming
- Near real-time dashboards and alerting
- Big data: Lake house, warehouse systems
- Big data tools: Apache Spark, Hadoop, Hive
- Lakehouse architectures: Redshift, Trino, Delta Lake, S3
- AWS: Kubernetes, S3, EMR, Redshift, Glue
- GCP: BigQuery
- RDBMS: Oracle, MySQL, PostgreSQL
- NoSQL: MongoDB
- API management: FastAPI/Swagger, secure gateway design, and microservices
- Team leadership and mentoring: 15 or more data engineers
- Agile/Scrum delivery: PSM certified
- Cross-functional collaboration
Certification
- AWS Certified Solutions Architect - Professional — 2025-01
- Oracle Certified Professional, Java SE 6 — August 2014
- Professional Scrum Master (PSM) — 2023-01
Awards
RockStar Award — 2023, Physics Wallah, Hall of Fame — 2020, Paytm, Best Innovator — 2017, TCS
Timeline
Data Platform & Solution Architect
Physics Wallah
07.2023 - Current
Senior Principal Engineer
Bharti Airtel (Wynk)
02.2022 - 06.2023
Lead Data Engineer
Paytm (One97 Communication)
05.2018 - 02.2022
System Engineer / Data Engineer
Tata Consultancy Services
12.2015 - 05.2018
B.Tech - Computer Science and Engineering
Jaypee Institute of Information And Technology
Senior Secondary Education -
Sir Padampat Singhania Education Center
High School Education -
B.N.S.D. Siksha Niketan Inter College