BIPIN PALMUR
Pune
Summary
Strategic Big Data Engineering Leader and Technical Product Owner with 13 years of experience in developing scalable data platforms and security solutions for banking. Expertise in integrating complex data architecture (Hadoop, Spark, Kafka) with product strategy across Threat Intelligence and surveillance operations. Focused on defining product roadmaps and aligning technical execution with business goals, currently pursuing an M.Tech in AI/ML to enhance system innovation.
Overview
13
13
years of professional experience
Work History
Engineering Lead - Vice President
Barclays Global Services Ltd.
Pune
03.2025 - Current
- Drive the enterprise-wide deployment of the DataWalk product into Barclays, architecting and executing its first-ever implementation within the organization.
- Lead product vision and roadmap execution for the Threat Intelligence program, focusing on converged security encompassing cyber, geospatial, and physical risks.
- Spearhead the integration of diverse intelligence feeds (including Silobreaker, Everbridge, NCFTA, and internal telemetry) into centralized data systems to drastically enhance the organization's threat detection and response capabilities.
Big Data Engineering Lead - Assistant Vice President
Barclays Global Services Ltd.
Pune
01.2022 - 03.2025
- Led product vision and roadmap execution for the Electronic Communications Surveillance program.
- Architected and delivered an in-house Big Data solution consolidating regional data processing workflows, successfully replacing legacy vendor products and optimizing operational efficiency.
- Spearheaded the integration of diverse feeds (including MS Teams, Outlook, Bloomberg, Reuters) into centralized data systems to enhance the organization's conduct surveillance capabilities.
- Directed the development of advanced NLP pipelines (Fasttext, LaBSE, vector embeddings) in PySpark to process, analyze, and extract actionable insights from complex electronic communications data.
- Collaborated cross-functionally with Data Science teams to seamlessly deploy and integrate AI/ML models directly into Spark workflows for advanced detection and alerting.
- Established robust data governance and security compliance, ensuring automated secrets consumption via HashiCorp Vault and secure data writing to Elasticsearch.
Big Data Engineer and Architect - Assistant Vice President
Barclays Global Services Ltd.
Pune
08.2018 - 01.2022
- Architected the migration of on-premise Hadoop environments to AWS using Kafka, AWS Glue, and StreamSets for critical Cyber Security use cases.
- Designed and implemented a centralized security message bus using Kafka, acting as a high-throughput pub-sub layer for upstream and downstream security applications.
- Engineered real-time data processing workflows utilizing PySpark, StreamSets, and Kafka.
- Integrated AI/ML models into Spark workflows to automate the generation of security-related anomalies.
- Integrated Kafka with Splunk to streamline alert generation and monitoring.
Senior Hadoop Engineer
MapR Technologies
Hyderabad
01.2018 - 08.2018
- Provided expert-level technical support for enterprise customers, troubleshooting and resolving complex architectural and performance issues related to Apache Spark, Hive, and Impala within the MapR Hadoop ecosystem.
Senior Hadoop Administrator (Client: Barclays)
Tata Consultancy Services
Pune
01.2013 - 01.2018
- Led Hadoop administration to deploy and manage diverse Hadoop clusters across global regions (Manchester, London, Pune), ensuring seamless data processing and accessibility.
- Defined and enforced security standards by implementing robust Role-Based Access Control (RBAC) models to safeguard sensitive data.
- Implemented comprehensive end-to-end encryption (at-rest and in-transit) across the Hadoop infrastructure to meet strict banking compliance standards.
- Delivered Big Data Proof of Concepts (POCs) for enterprise clients, demonstrating innovative solutions as part of Big Data Center of Excellence (CoE).
Education
M.Tech - AI-ML
BITS Pilani
01-2027
Bachelor of Engineering - Electronics and Telecommunications
Solapur University
01-2012
HSC Science -
Walchand College, Solapur
01-2008
Skills
- Product Strategy & Roadmap
- Technical Leadership
- Cloud technology
- Data architecture
- Machine learning
- AI integration
- Apache Hadoop
- Apache Spark
- PySpark
- Kafka
- AWS (EC2, S3, Glue, Kinesis)
- ElasticSearch
- Databricks
- DataWalk
- Python
- Streamsets
- Logstash
- Kibana
- MSSQL
- Linux
- Data analysis
- Project management
- Threat Intelligence
Accomplishments
- Qualified as a team finalist for the Barclays Group Technology Awards 2025 for developing an innovative in-house product.
- Nominated for the Exceptional Achievement Awards 2025.
- Recipient of the Barclays Global Citizenship Award 2024 for contributions to CSR activities.
Skills
Product Strategy & Roadmap, Threat Intelligence, Electronic Communications Surveillance, Technical Leadership, Data Governance, Apache Hadoop, Apache Spark, PySpark, Kafka, AWS (EC2, S3, Glue, Kinesis), ElasticSearch, Databricks, DataWalk, Python, Shell Scripting, Streamsets, Logstash, Kibana, Oracle, MSSQL, Linux
Timeline
Engineering Lead - Vice President
Barclays Global Services Ltd.
03.2025 - Current
Big Data Engineering Lead - Assistant Vice President
Barclays Global Services Ltd.
01.2022 - 03.2025
Big Data Engineer and Architect - Assistant Vice President
Barclays Global Services Ltd.
08.2018 - 01.2022
Senior Hadoop Engineer
MapR Technologies
01.2018 - 08.2018
Senior Hadoop Administrator (Client: Barclays)
Tata Consultancy Services
01.2013 - 01.2018
M.Tech - AI-ML
BITS Pilani
Bachelor of Engineering - Electronics and Telecommunications
Solapur University
HSC Science -
Walchand College, Solapur