Abhishek Kumar Singh
Karnataka
Summary
Dynamic Sr. Staff Data Engineer at Visa with a proven track record in architecting scalable data solutions and implementing AI/ML models. Expert in big data pipelines and fostering cross-functional collaboration, driving improvement in data processing performance while delivering actionable insights in the Merchant, fintech and insurance domains.
Overview
13
13
years of professional experience
Work History
Sr. Staff Data Engineer
Visa
Bengaluru
10.2018 - Current
- Data Architecture & Design: Led end-to-end design of scalable, fault-tolerant data pipelines and systems supporting multi-petabyte datasets.
- AI-Driven Merchant Insights: Designed AI/ML models to predict merchant churn, segment merchants based on behavior, and forecast sales trends, enabling data-driven business strategies.
- Advanced Data Engineering: Expert in building batch and real-time ETL/ELT pipelines using technologies like Spark, Kafka, Airflow.
- Deep Domain Knowledge: Extensive experience working within the merchant ecosystem, including payment processing, transaction lifecycle, settlement, reconciliation, and risk management.
- Merchant Data Strategy: Designed and implemented data models and pipelines tailored for merchant analytics, enabling insights into sales trends, customer behavior, and operational efficiencies.
- Fraud & Compliance: Built scalable data solutions to monitor merchant activity, detect anomalies, and ensure compliance with regulatory standards .
- Cross-Functional Leadership: Collaborated with data scientists, product teams, and business stakeholders to translate requirements into scalable, technical solutions.
- Performance Optimization: Improved data processing performance by 30-50% through partitioning strategies, query tuning, and storage optimization techniques.
- Stakeholder Communication: Communicated complex technical strategies and trade-offs to executive leadership and non-technical stakeholders.
Associate Architect
Devon
Bengaluru
05.2016 - 10.2018
- Big Data Solution Design: Spearheaded the architecture of scalable, high-performance big data platforms, handling billions of eCommerce transactions, clickstreams, and customer interactions.
- Cloud-Native Architecture: Designed and implemented cloud-based data ecosystems (AWS, GCP, Azure), utilizing services like EMR, BigQuery, Redshift, or Databricks to enable efficient data storage, processing, and analytics.
- Real-Time & Batch Processing: Architected hybrid data pipelines leveraging Kafka, Spark, Streaming and Airflow to support both real-time recommendations, fraud detection, and batch reporting needs.
System Analyst
Infosys
Bengaluru
12.2015 - 05.2016
Systems Engineer
Tata Consultancy Services
Kolkata
08.2012 - 12.2015
- Data Systems Implementation: Specialized in designing and deploying robust data systems to manage large volumes of policyholder, claims, underwriting, and actuarial data within the insurance sector.
- ETL & Data Pipelines: Built and optimized ETL/ELT pipelines to ensure accurate ingestion, transformation, and delivery of critical insurance data across multiple platforms.
- Claims & Policy Analytics: Supported analytics platforms to enable real-time reporting on claims processing, fraud detection, premium calculations, and risk assessment models.
Education
M-Tech - Systems Software
BITS Pilani
Pilani07-2016
B-Tech - Computer Science And Engineering
Jis College of Engineering
Kalyani07-2012
Skills
- Data pipelines
- Big data solutions
- AI/ML solutions
- Built Merchant end-to-end solutions
- Expertise in the insurance domain
- Rich Fintech experience
Timeline
Sr. Staff Data Engineer
Visa
10.2018 - Current
Associate Architect
Devon
05.2016 - 10.2018
System Analyst
Infosys
12.2015 - 05.2016
Systems Engineer
Tata Consultancy Services
08.2012 - 12.2015
M-Tech - Systems Software
BITS Pilani
B-Tech - Computer Science And Engineering
Jis College of Engineering
Similar Profiles
Nigar KhanNigar Khan
Senior Software Engineer at VisaSenior Software Engineer at Visa
MILES DOBBYNMILES DOBBYN
Director - Cybersecurity Strategy and Reporting at VisaDirector - Cybersecurity Strategy and Reporting at Visa
ASHLEY SLOCUMASHLEY SLOCUM
Associate, Talent Acquisition Program Management at VisaAssociate, Talent Acquisition Program Management at Visa