Dynamic Sr. Data Engineer at One97 Communication Ltd (Paytm) with expertise in designing robust data pipelines and optimizing performance. Proven track record in real-time data processing and proactive problem-solving, leveraging skills in PySpark and cloud storage to enhance operational efficiency and drive impactful data-driven decisions.
Hi, I’m
Praful Saxena
Senior Data Engineer
Noida,U.P
Summary
Overview
8
years of professional experience
3
Certification
Work History
SBI CardGurgaon, Haryana
Manager Data Strategy
09.2026 - Current
Job overview
- Identified and resolved data-handling errors and hardware conflicts to maintain organizational IMS infrastructure.
- Developed information extraction and monitoring practices based on up-to-date InfoSec standards.
- Lent qualitative analytical support to lead data analysis testing policy.
One97 Communication Ltd (Paytm)Noida
Sr. Data Engineer
03.2023 - 09.2026
Job overview
- Collaborated with Consumer and Merchant teams to align features with business needs.
Developed and debugged customer features for optimal functionality.
Managed data processing and storage across AWS S3.
Designed ETL pipelines for efficient data warehouse loading.
Maintained 99% uptime for streaming/transactional pipelines using PySpark.
Set up Apache Airflow, building DAGs and migrating flows from Azkaban.
Built AI tools on MCP server to automate feature development, shifting from manual coding to prompt-based workflows that auto-generate, deploy, and activate features.
Designed real-time Kafka pipelines with adapter streaming integrated via GET/PUT/POST APIs for event-driven delivery.
Built an automated ETL pipeline mapping customers to phone numbers, with a TSX dashboard for self-serve use; Scala/Azkaban backend delivered mapped CSVs via presigned email URLs.
Optimized ETL pipelines, cutting costs by 40% and runtime by 35% via performance tuning.
Designed a migration strategy from traditional data warehouse to Lakehouse, evaluating performance, cost, and governance for feature engineering pipelines.
Built a near real-time location enrichment pipeline via Kafka, replacing 30-min batch SFTP; enriched events in-stream (GeoHash from lat/long) and pushed to CleverTap in real time via External Adaptor/Enricher.
NCC LimitedLucknow
Jr. Engineer
04.2018 - 03.2023
Job overview
- Provide Analytical and Statistical solutions to the team by performing data analysis of machinery and plant performance, production and categorizing them in orders, which in turn helps to find the maximum usage of the machinery and plants. Hence, surge the efficiency.
- Reviewing and recommending improvements of all SOP procedures. Reviewing datasets related to machineries, plants over ERP (UCIIMS) and Tappet-Box. Acquiring data from primary or secondary data sources and maintaining databases.
- Work with Relational databases such as MySQL, SQL Server. Manage SQL Server databases through multiple product lifecycle environments.
- Extracting data from source Tappet-Box and Max-Pro. Performing DDL, DML operations as per client requirement and providing the insights. Documented the data such as ER and attributes, file descriptions and definitions.
- Ensured Data recovery, Maintenance and Data Integrity and space requirements for database. Developed reports, views and triggers for data analysis.
- Worked with join patterns, implemented Map side joins, and reduce side joins using Map-Reduce. Developed multiple map-Reduce jobs to perform data cleaning and pre-processing.
- Implemented and optimized Hadoop/Map-Reduce algorithms for Big-data analytics. Implementing pre-defined operators in spark such as map, flat map, filter, reduceBykey, groupby, aggregateBykey etc.
Education
Imarticus Learning InstituteLucknow
from Machine Learning
12-2022
University Overview
U.P.T.ULucknow
Bachelors of Technology from Mechanical Engineering
06-2014
University Overview
State Board of U.PLucknow
Senior Secondary
University Overview
State Board of U.PLucknow
Secondary
University Overview
Skills
- Apache Kafka
- Kafka Streaming
- Python
- SQL
- Advanced SQL
- PySpark
- Apache Spark
- Data Pipelines
- Data Architecture
- Real-Time Processing
- Real-Time Analytics
- Streaming Data
- ETL
- ETL Optimization
- Data Integration
- Data Modeling
- Data Warehousing
- Data Governance
- Cloud Storage
- AWS S3
- AWS
- Cloud Computing
- Big Data
- Big Data Analytics
- Hadoop
- HDFS
- Apache Airflow
- Workflow Orchestration
- DAG Development
- Azkaban
- Job Scheduling
- Data Analysis
- Exploratory Analysis
- Machine Learning
- ML Algorithms
- NLP
- Deep Learning
- Neural Networks
- Time Series Analysis
- Predictive Modeling
- Statistical Analysis
- Tableau
- Data Visualization
- Business Intelligence
- Dashboards
- Performance Tuning
- Query Optimization
- Cost Optimization
- Distributed Systems
- Event-Driven Architecture
- API Integration
- REST APIs
- Microservices
- Data Engineering
- Lakehouse Architecture
- Data Lake
- Database Administration
- Relational Databases
- NoSQL
- Scala
- TSX
- Frontend Development
- Backend Development
- CI/CD
- Git
- Agile
- Collaboration
- Stakeholder Management
- Documentation
- Problem Solving
- Debugging
- Automation
- AI Tool Integration
- Prompt Engineering
- MCP Server
- Feature Engineering
- Data Quality
- Data Security
- Self-Service Tools
Certification
- Completed Python course from Udemy (Advanced)
- Completed Machine-learning course from Internshala
- Completed Six Sigma Course from IIBM
Projects
Projects
E-Commerce Shipping Delivery Dataset (Advanced ML), 06/01/22 - 07/31/22, In order to check whether the product will deliver on time or not, since delivery of the product is based on mode of transport, location and availability of the product. Therefore, it is very urgent to perform the EDA and pre-processing because it will refine our data to perform ML algorithms., NumPy, Pandas, PCA, Machine Learning Age-Gender-Ethnicity Face Detection by Using CNN, 10/01/22 - 11/30/22, I took a dataset of real time UTK age, gender, ethnicity face dataset in this I have performed Data Distribution work, Image Pre-Processing work and Convolutional Neural Network to make prediction of the ethnicity, age and gender. Use of CNN on this dataset and motto is to identify a person face by his ethnicity because in near future this AI will be applicable in government agencies., OpenCV, Keras/TensorFlow, Deep Learning
Achievements Extracurricular Activities
Achievements Extracurricular Activities
- Secured 7th rank in KPMG Hackathon Skillenza Competition
- Achieved 2nd position in Inter College Football Competition
- Secured top 500 rank in Kaggle Competition Tabular Playground Series
- Worked on cancer Aid Society during National Cancer Control Program and awarded for awareness
- Enrolled as Volunteer at BHUMI NGO working for orphanage
Work Preference
Job Search Status
Open to workWork Type
Full TimeLocation Preference
HybridRemoteSalary Range
₹1800000/yr - ₹3500000/yrCoursework
Coursework
- Mathematics- Linear Algebra, Basic Calculus
- Machine Learning- Linear Regression, Classification, Ensemble Technique, Random Forest, KNN, SVM, PCA, Naïve Bayes
- Deep Learning- ANN (Artificial Neural Network), CNN (Convolutional Neural Network), RNN, NLP (Natural Language Processing), LSTM, Open-CV, Clustering
Timeline
Manager Data Strategy
SBI Card
09.2026 - Current
Sr. Data Engineer
One97 Communication Ltd (Paytm)
03.2023 - 09.2026
Jr. Engineer
NCC Limited
04.2018 - 03.2023
Imarticus Learning Institute
from Machine Learning
U.P.T.U
Bachelors of Technology from Mechanical Engineering
State Board of U.P
Senior Secondary
State Board of U.P
Secondary