Indranil Dey
Bangaluru
Summary
Results-driven big data engineer with proven success in utilizing big data technologies, especially Hadoop ecosystem and Storm for data streaming, to solve complex business issues, employing Java for object-oriented analysis, design, development, implementation, and thorough documentation throughout software development lifecycle processes. Self-motivated Data Streaming Engineer with expertise in Big Data technologies and a history of solving complex business challenges. Delivered robust data lake infrastructure and real-time data streaming solutions, leveraging Java, Scala, and a range of data processing frameworks. Focused on enhancing system integration and optimising data discovery across multi-cloud environments.
Overview
31
31
years of professional experience
Work History
Software Engineering Architect at AI Cloud
Salesforce
, CA
01.2019 - Current
- Designed multi-tenant data lake infrastructure for core and entity data.
- Built Scala Spark and Akka infrastructure for ad hoc pull APIs.
- Implemented SOQL filtering to retrieve Salesforce core data via SOAP and Bulk APIs.
- Reviewed designs and performed peer code reviews with mentorship support.
- Discussed microservice architecture choices and system integration approaches.
- Developed unified data catalog and discovery for multi-cloud data sources.
Data Engineering at Data Infrastructure team
Apple INC
, CA
06.2014 - 12.2018
- Review Java code with peers and join design discussions.
- Design and develop a data ingestion platform for vendor and streaming sources.
- Design and develop a validation framework and generic MapReduce jobs.
- Design and develop RESTful web services exposing MapReduce content via Scala and Play.
- Build a common transfer module moving data between file systems and HDFS using distcp.
Big Data Platform Engineer/Architect for the GBI Portal
Apple INC
, CA
01.2012 - 06.2014
- Designed and built iTunes reporting data ingestion interface on Apple Hadoop platform.
- Designed ClusterExecutor module to simulate Hadoop jar and run MapReduce jobs.
- Designed live streaming and enrichment using Twitter Storm and Cassandra into Hadoop.
- Designed and developed embedded data services using Spring JDBC 3.0.
- Owned GBI portal platform design for service provisioning infrastructure via Apache Camel routing.
- Developed GBI Cache with Ehcache, Spring JDBC, and Apache Camel for lookup search.
- Designed and developed real-time dashboard POC using Kafka, Twitter Storm, Oracle AQ, Atmosphere.
Lead Technical Architect
American Express (Business Travel)
, AZ
11.2010 - 12.2011
- Designed and built single booking platform for GDS and non-GDS systems.
- Implemented platform using Apache Camel, Spring MVC, and Spring Core.
- Managed 20-person team across offshore and onsite delivery.
- Reviewed code, audits, and defect analysis for release readiness.
- Measured performance and tuned JVM parameters for SOA platform.
- Planned hardware and software capacity to support platform demand.
Spring Framework Engineer
Pivotal (Formerly SpringSource)
, CA
01.2008 - 10.2010
- Design and develop multithreaded distributed batch processing workflow using Spring Batch and Spring Integration.
- Architect and implement entitlement management system and greenhouse project using JBoss Portal and vFabric suits.
- Design and develop license management portal using Spring MVC, Spring Core, Hibernate, Spring Security.
- Develop Java APIs for licensing component using Spring Core, Hibernate, Spring Security.
- Participate in architecture reviews, design reviews, and code reviews.
- Fix bugs and enhance Spring modules, focusing on Spring JDBC, Spring Batch, and Spring Integration.
Lead Architect
HTC Global Services INC
, MI
03.2003 - 12.2007
- Mentored 10 Java/J2EE developers across offshore and onsite teams daily.
- Collected stakeholder and business analyst concerns for architectural inputs.
- Designed service layer and persistence classes using Spring 2.0 and Hibernate 3.0.
- Implemented logging via Spring AOP for application tracing.
- Implemented security interceptors using Spring Security.
- Owned architectural and infrastructure design decisions end-to-end.
- Integrated Spring 2.0 with Struts 1.2.x for front-end delivery.
- Collaborated with Gale chief architect on gold framework architecture.
- Integrated system with Gale legacy content repository vault.
- Designed content repository and search engine using Jakarta Jackrabbit.
- Architected single sign-on gateway based on OnePass web service.
- Integrated syllabus builder with Sakai course management systems at MI State University.
- Implemented SealedMedia DRM integration in web tier via custom request processor.
- Delivered syllabus builder and virtual reference library for Thomson Gale.
Tech Lead
Patni Computers
Mumbai, INDIA
01.1996 - 02.2003
- Led offshore team of 4 Java developers through daily delivery work.
- Handled architecture and design decisions across multiple service modules.
- Designed and developed authentication and authorisation module for secure access flows.
- Built and optimised Motorola web claim processing engine for 1000/2000 TPS.
- Architected database-driven rule engine for claim processing workflows.
Education
Bachelor of Science -
Calcutta University
01.1995
GNIIT Computer Diploma -
NIIT
Skills
- Java and J2EE
- Big data technologies
- Data pipeline development
- Real-time data streaming
- Fraud detection engineering
- Event-driven architecture
- Apache Kafka and Flume
- Hadoop ecosystem
- Data transformation processes
- Spring framework suite
- MapReduce and Pig
- Cascading and Spark
- Large language model
- Spring AI
Custom Section
- Https://github.com/deyindra/Sudoku
- Https://github.com/deyindra/MergeSort
- Https://github.com/deyindra/ExcelEvaluation
- Http://indranil1971.blogspot.com/2016/01/generate-prime-table.html
- Http://indranil1971.blogspot.com/2016/01/given-3-postive-number-n1-n2-and-n3.html
- Http://indranil1971.blogspot.com/2016/01/find-if-binary-representation-of-32-bit.html
- Http://indranil1971.blogspot.com/2014/12/iterator-fun.html
Timeline
Software Engineering Architect at AI Cloud
Salesforce
01.2019 - Current
Data Engineering at Data Infrastructure team
Apple INC
06.2014 - 12.2018
Big Data Platform Engineer/Architect for the GBI Portal
Apple INC
01.2012 - 06.2014
Lead Technical Architect
American Express (Business Travel)
11.2010 - 12.2011
Spring Framework Engineer
Pivotal (Formerly SpringSource)
01.2008 - 10.2010
Lead Architect
HTC Global Services INC
03.2003 - 12.2007
Tech Lead
Patni Computers
01.1996 - 02.2003
Bachelor of Science -
Calcutta University
GNIIT Computer Diploma -
NIIT