Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Subhashish

Bengaluru

Summary

Delivered over two decades of unparalleled technical expertise in spearheading and designing large-scale, distributed, and complex architectures with exemplary execution.

Designed and executed Cloud platform architectures aligning with the company's vision, ensuring robust Cloud infrastructure and platform services. with end-to-end security and compliance controls.

Led the design and development, from inception, of numerous data-intensive applications and platforms on AWS infrastructure. Ranging from backend web services to cloud-native, self-service big data services (PaaS), these initiatives helps to develop reliable, high-throughput batch, and real-time data pipelines. These solutions were instrumental in delivering significant IoT and machine learning capabilities.

Extensive experience collaborating with customers, project managers, and technical teams to secure and successfully execute concurrent projects. Collaborated with senior management to provide strategic technology direction aligning with organizational objectives.

Contributed significantly to the open-source community, including an SDK on Mesos, an API rate limiter leveraging Redis, and a high-throughput Spark/AWS Glue framework for processing massive data volumes in a serverless framework.

Overview

22
22
years of professional experience
1
1
Certification

Work History

Principal Software Engineer

Palo Alto Networks
10.2020 - Current
  • Engineered a versatile, configuration-driven Microservice facilitating seamless data transformation and ingestion between AWS S3 and MongoDB. This pivotal solution empowered dynamic user dashboards, superseding static report systems.
  • Mentored junior engineers on controller architecture, distributed systems, and coding best practices, fostering team growth and skill development.
  • Led the entire lifecycle of critical Controller features such as Multicast in LAN, Branch-to-Branch setup, IPv6 in WAN, and VRF. Notably, the Multicast branch-to-branch feature served as a robust fail-safe solution during the FIFA Worldcup 2022, earning accolades from the customer.
  • Conceptualized and executed a Proof of Concept (PoC) for a Microservice managing Traffic Flows data exceeding ~21TB daily. This initiative aimed to eliminate reliance on GCP data flow, culminating in a successful PoC and subsequent development of the production version. Initial estimate suggests a reduction of cost by ~7x.

Staff Software Engineer

INTUIT
10.2018 - 08.2020
  • Led the technical discussions and future roadmap of products to accurately align to business outcome
  • Mentored and trained other team members on design practices, and coding standards
  • Instrumental in redesigning the data ingestion of the Customer Billing information which saved ~650K USD
  • Led a team from multiple teams/BUs to redesign and develop a few of the largest and most complex data pipelines in the Consumer group by unifying data from 103 AWS RDS MySql shards with a throughput of 2 Billion events per day. The solution saved total job run time by 46 hours and $30K per year savings. This is acknowledged as the most impactful project of the year in the data engineering group
  • Led the migration of ~220 Terabytes of data warehouse solution (MPP DB and data pipelines) from an on-premise data centre to AWS with complete re-encryption of data
  • Performed multiple PoCs to improve the existing processes with clearly stated outcome

Staff Software Engineer

GE Digital
04.2015 - 10.2018
  • Spearheaded one of the cloud data services teams to build IoT focused cloud native self-service distributed data platform for Predix.io, GE's public cloud platform on AWS; the product supported more than 5000 instances of Postgresql in a multi-tenant environment
  • Ingested ~600 tables as part of GE's Data Lake initiative
  • Led the design & development of the first near real-time data ingestion pipeline for GE's IoT platform which garnered huge appreciation from GE’s top leadership
  • Led multiple PoCs and collaborated with customers and executives to improve existing processes
  • Extensively worked with multiple Silicon Valley start-ups as part of GE's partner ecosystem
  • Trained people on data lake, microservices and cloud computing

Specialist Senior

Deloitte Consulting LLC
12.2012 - 03.2015
  • Worked as Data Solution Architect and Team Lead and designed/developed various solutions for a range of customers on data integration (ETL), BI and Big Data such as Hadoop

Senior Associate

Cognizant Technology Solutions
02.2010 - 12.2012
  • Technical Lead & Client Service Liaison for designing technical architectures & solutions for various data engineering requirements
  • Analyzed and prepared architecture definition, design patterns & solution for the project and designed & selected appropriate technologies for development approach
  • Managed large data engineering project to consolidate data landscape for a large Healthcare organization, designed and developed the ETL workflow for more than 160 tables.

IT Analyst

Tata Consultancy Services
08.2008 - 02.2010
  • Worked as a Data Analyst and carried out exploratory data analysis
  • Engaged & coordinated data analysis sessions for understanding client business requirements and mapping them to required framework standards
  • Evaluated workflow tools & processes to ensure they are efficient, high quality, and scalable

Senior Software Engineer

INFOSYS
11.2003 - 08.2008
  • Successfully implemented the migration of 100+ tables from mainframe systems into Oracle & MS SQL Server using Informatica and SSIS
  • Contributed as Onsite (USA) Lead Developer and developed a data analysis solution for a large North American financial organization using Java/J2EE, LDAP, HTML, JavaScript, Actuate & MSSQL Server in a waterfall SDLC model; the project received the best project of the year award from the customer

Education

Bachelor of Engineering - Mechanical Engineering

National Institute of Technology
Silchar, Assam
2002

Skills

    Java, Go, Python, Microservices, MongoDB, GCP PubSub, BQ, Docker, Kubernetes, Cloud Foundry, Consul, Redis, RESTful, DataLake, ETL, CDC, Hadoop, Kafka, Spark, PostgreSQL, Vertica, Linux, SQL, CI/CD, Scrum, AWS VPC, IAM, S3, RDS, Glue, Elasticsearch, EMR, SQS, Presto & AWS SDK

Certification

Nanodegree: Deep Learning | Udacity, Mountain View, CA | 2018

Timeline

Principal Software Engineer

Palo Alto Networks
10.2020 - Current

Staff Software Engineer

INTUIT
10.2018 - 08.2020

Staff Software Engineer

GE Digital
04.2015 - 10.2018

Specialist Senior

Deloitte Consulting LLC
12.2012 - 03.2015

Senior Associate

Cognizant Technology Solutions
02.2010 - 12.2012

IT Analyst

Tata Consultancy Services
08.2008 - 02.2010

Senior Software Engineer

INFOSYS
11.2003 - 08.2008

Bachelor of Engineering - Mechanical Engineering

National Institute of Technology
Subhashish