Balakrishnan Jagadeesan
Data Engineering Architect Lead
Bengaluru,KA
Summary
Dynamic platform architect with over 2 decades of experience in enterprise software and over a decade focused on developing cloud-scale data platforms and pipelines. Expertise includes creating scalable, secure, and resilient platforms that empower teams, unlock valuable insights, and deliver high-performing, reliable data ecosystems across hybrid and multi-cloud environments. Proven track record of driving innovation and efficiency while ensuring seamless integration and optimal performance. Committed to leveraging advanced technologies to meet evolving business needs and enhance organizational capabilities.
Overview
26
26
years of professional experience
Work History
Technical Architecture Leader (Senior Development Manager)
Oracle
08.2020 - 10.2025
- Led architecture, design, and end-to-end delivery of Oracle Data Transform—a serverless, multi-tenant data-integration platform built natively on Oracle Autonomous Database Platform.
- Directed a cross-functional engineering team spanning backend, orchestration, DevOps, and observability to deliver a production-grade system used across Oracle Cloud customers.
- Architectural Ownership: Defined technical roadmap, platform design, and implementation strategy for Oracle Autonomous Data Transform, integrating metadata-driven orchestration, serverless scheduling, and high-availability runtime services.
- Dynamic Execution Platform: Implemented distributed executor framework inside every transformation container in Oracle Data Transforms that automatically adjusted thread pools per step (SQL, PL/SQL, ingestion, API calls), improving end-to-end pipeline time by ~30%.
- Broker & Authentication Services: Integrated a Kubernetes-native Broker Orchestrator managing SSO (OpenID), token lifecycle automation, and containerized job execution, strengthening platform security and cutting operational toil.
- Hybrid Multi-Cloud Pipelines: Built a hybrid, multi-cloud data pipeline framework (OCI ↔ AWS ↔ Azure) unifying real-time (Oracle ADB → Debezium → Kafka → Flink SQL → Iceberg) and batch (Spark) flows with governed metadata, access controls, encryption, schema evolution, and exactly-once guarantees.
- Orchestration Framework: Implemented a pluggable orchestration engine (Airflow + Oracle Data Transform Workflow) supporting dynamic dependency resolution, parallel execution, and hybrid-cloud pipeline coordination across streaming and batch jobs.
- Observability & FinOps: Integrated OpenTelemetry-based monitoring, cloud logs with ElasticSearch/Kibana and FinOps guardrails — Enabled Data Transforms to right-size on start, scale on demand, and drop to zero—delivering ~30% cost savings and faster pipelines.
- Delivered a secure, always-on serverless platform enabling faster onboarding of new data sources and zero-touch scalability.
- Improved operational efficiency and mean-time-to-recovery (MTTR) through enhanced observability and predictive orchestration.
- Lowered infrastructure cost ~30 % while maintaining SLA 99.95 % uptime and consistent performance SLOs.
Technical Architect (Consulting Member of Technical Staff)
Oracle
04.2016 - 08.2020
- Architected and delivered enterprise-grade cloud data integration platforms across multiple Oracle Cloud products, focusing on high availability, multi-tenancy, and orchestration reliability.
- Key Projects & Contributions: Oracle Data Integrator (ODI) on OCI Marketplace: Designed and deployed Oracle Data Integrator as a SAAS offering on OCI Marketplace with automated HA setup, leader election, and health monitoring. Enabled secure multi-tenant provisioning and zero-downtime upgrades for enterprise customers.
- Oracle Cloud Infrastructure (OCI) Data Integration: Built cloud-native orchestration and scheduling layers combining Airflow and Quartz, supporting hybrid scheduling models and improving workflow reliability and recovery speed.
- Data Integration Platform Cloud (DIPC): Engineered a bulk-load framework using Oracle Data Pump with parallel, restartable jobs for high-volume data migrations—reducing migration time by 40 %. Designed and implemented the Job Metrics and Monitoring Component—a unified lifecycle tracker aggregating runtime metrics, health data, and performance insights across distributed agents.
- Delivered highly available, secure, and fault-tolerant integration services powering thousands of customer workloads.
- Improved workflow reliability, automated failure recovery, and accelerated large-scale data migration throughput.
- Strengthened cross-product interoperability between on-premises and Oracle Cloud services.
Senior Principal Engineer (Senior PMTS)
Oracle
03.2013 - 04.2016
- Architected and extended Oracle Data Integrator (ODI) to support next-generation big data and cloud-native workloads.
- Key Contributions: Big Data Integration: Expanded ODI capabilities to handle modern Hadoop ecosystems by adding native support for Avro, Parquet, ORC, and JSON formats, and enabling execution on Spark, Hive, and Pig engines.
- High Availability & Failover: Implemented robust HA scheduling, cluster-aware load balancing, and automated failover for mission-critical data flows.
- Cloud-Native Enablement: Automated lifecycle deployments of ODI on Oracle’s Gen-1 Cloud using REST APIs and Infrastructure-as-Code (Terraform), simplifying provisioning and scaling.
- Brought ODI into the big-data era with seamless integration to Hadoop and Spark ecosystems.
- Strengthened reliability and disaster-recovery posture for enterprise data workloads.
- Pioneered early automation for ODI cloud deployment—setting the foundation for later Autonomous Data Transform work.
Senior Principal Engineer (Senior PMTS)
Oracle
04.2012 - 03.2013
- Revitalized the legacy BEA AquaLogic Data Services platform into a modern Oracle Data Service Integrator (ODSI) offering for federated, real-time data access.
- Key Contributions: Platform Modernization: Re-engineered AquaLogic into Oracle Data Service Integrator, introducing modular, scalable components and aligning with Oracle Fusion Middleware standards.
- Federated Query Engine: Designed SOA-based query federation across heterogeneous data sources, optimizing query rewriting, caching, and execution plans for high-throughput virtualized access.
- Integration Architecture: Delivered reusable data service patterns for seamless integration with Oracle Fusion, WebLogic, and Oracle Database environments.
- Transformed a legacy product into a modernized, cloud-ready data-service platform.
- Enabled high-performance federated queries with significantly improved throughput and reduced latency across diverse data sources.
Principal Engineer (PMTS)
Oracle
04.2000 - 04.2012
- Led architecture and modernization of Oracle Portal and WebCenter platforms, driving large-scale migration, extensibility, and upgrade initiatives across multiple product releases.
- Provided end-to-end architectural oversight for export/import frameworks, upgrade utilities, and enterprise security integration.
- Key Contributions: Portal to WebCenter Migration: Led the end-to-end architecture for migrating Oracle Portal to Oracle WebCenter Spaces, developing an extensible XML-based migration framework ensuring seamless content and metadata transformation.
- WebCenter Attachments (PeopleSoft Integration): Designed and delivered context-driven UI injection using Smart Tags, enabling deep integration of WebCenter Attachments within PeopleSoft Applications Unlimited.
- Patented SQL-Based Export/Import Framework: Invented and patented (US Patent #7346627) a high-performance SQL-based system for Portal export/import across environments (DEV → TEST → PROD), dramatically reducing migration time and complexity.
- Upgrades and Platform Modernization: Led multiple in-place version upgrades, improving platform extensibility, performance, and user experience across Oracle Portal releases.
- Leadership: Headed the IDC Portal Engineering team, mentoring engineers across architecture, performance, and release engineering domains.
- Modernized Oracle Portal ecosystem and transitioned enterprise customers to WebCenter-based platforms.
- Introduced patented export/import technology, setting a new standard for large-scale migration efficiency.
- Enhanced platform usability, scalability, and security—benefiting thousands of enterprise deployments worldwide.
Senior Programmer
Zeta Infotech
05.1999 - 04.2000
- Designed and implemented core banking modules in VB and Oracle for retail-finance operations.
- Built reusable components for transaction validation, interest computation, and audit logging.
- Improved data integrity and shortened transaction-processing time across ICDS Bank’s branch network.
Education
Master of Computer Application -
University of Madras
Bachelor of Science - Mathematics
University of Madras
Skills
- Skilled in managing professional relationships
- Experienced in managing disputes
- Long-term strategic planning
- Inspiring team performance
- Influencing others
- Continuous improvements
- Visionary thinking
- Team building
- Team leadership
- Goal setting
- Risk assessment
- Cross-functional collaboration
- Training and mentoring
- Analytical thinking
Timeline
Technical Architecture Leader (Senior Development Manager)
Oracle
08.2020 - 10.2025
Technical Architect (Consulting Member of Technical Staff)
Oracle
04.2016 - 08.2020
Senior Principal Engineer (Senior PMTS)
Oracle
03.2013 - 04.2016
Senior Principal Engineer (Senior PMTS)
Oracle
04.2012 - 03.2013
Principal Engineer (PMTS)
Oracle
04.2000 - 04.2012
Senior Programmer
Zeta Infotech
05.1999 - 04.2000
Bachelor of Science - Mathematics
University of Madras
Master of Computer Application -
University of Madras
Core Architecture Competencies
- Solution & Enterprise Architecture
- Data Architecture & Lakehouse Practices
- Streaming & Hybrid Pipelines
- Runtime & Platform Architecture
- Resilience, Security & Reliability
- Leadership & Governance
- Critical Thinking & Decision Frameworks
Technical Stack
Java, JDBC, SQL/PLSQL, Python, PySpark, Oracle-OLTP, Oracle Autonomous Database (ADB-S), MySQL, ODI Agents, Apache Spark (batch/stream), Kafka, Debezium, Apache Flink SQL, OCI Object Store, S3, Hadoop/HDFS, Hive, Parquet, AVRO, Apache Iceberg, Gravitino, ODI Packages/LoadPlans, Apache Airflow, Oracle DBMS-scheduler, Quartz, Containers/Kubernetes, ADB Broker, OCI services, Terraform, ANT/Maven, Redis Distributed Cache, Oracle In-Memory Cache, Oracle Coherence, logs/metrics/traces (OpenTelemetry-first), Elastic Search, Kibana, IAM design, OpenID Connect (OIDC)/OAuth 2.0, token & credential rotation, policy as code
Signature Platform Innovations
- Dynamic Executor Framework
- Scheduler Watchman
- Federated Execution Agents
- Dynamic Job Configuration Framework
- Pluggable Execution Engines
- FinOps Guardrails
- Security & HA/DR Patterns
- Reliability & Recovery Patterns
Patents And Awards
- US Patent – Oracle Portal Export/Import Framework (US7346627)
- IDC Innovation Competition – Joint First Prize (Developer Integration Platform)
- Oracle PaaS Hackathon – 2nd Prize (ODI Cloud POC)
- Oracle Appreciation Award for Engineering Excellence for improving Portal Import performance 100 times.
Focus Areas
- Data Platform & Cloud-Scale Architecture
- Data Engineering
- Data Integration & Governance
- Streaming & Lakehouse Architectures
- Hybrid & Multi-Cloud Data Pipelines
- Containerization & Orchestration
- Security, IAM & Zero-Trust
- Leadership, Architectural Governance & Critical Thinking