Highly skilled SRE/Architect with 15 years of overall experience designing and implementing cloud-based solutions(AWS/GCP), system integrations, and data migration strategies. Proven track record in reducing infrastructure costs by 50%, increasing system reliability by 30%, and improving overall system performance by 15%. Proven experience in optimizing multi-platform database environments, including PostgreSQL, Vertica, Google BigQuery, Teradata, and DB2. Database design, performance tuning, high availability, and cloud migration. Implement scalable and secure database solutions to support business-critical applications. Strong collaborator with cross-functional teams, developing and migrating architecture standards, and providing technical guidance and support to drive project success.
Modernized batch and streaming pipelines using:
Cloud Dataflow for stream and batch processing (Apache Beam-based pipelines).
Pub/Sub for decoupled, scalable messaging between microservices.
Dataproc for migrating on-prem Hadoop/Spark jobs to managed GCP services.
Automation, CI/CD & DevOps
Automated infrastructure provisioning using Terraform.
Jenkins for build/test automation.
Armada for orchestrating complex delivery pipelines.
Orchestration & Workflow Management
Utilized Cloud Composer for:
* Scheduling and orchestrating ETL workflows.
* Integrating tasks across Dataflow, Dataproc, Pub/Sub, GCS, and BigQuery.
* Implementing retry logic, SLA tracking, and auditability in workflows.
Monitoring, Logging, & Reliability Engineering
Monitored services using Cloud Monitoring.
Centralized logs with Cloud Logging and created alerting policies for anomaly detection.
Cost Optimization and Governance
Monitored and optimized cloud spend using Billing Reports, Budgets etc.
Rightsized Compute Engine VMs, tuned auto-scaling parameters, and sunset unused resources.
Implemented resource labels, folders, and organization policies for effective governance.
Database Administrator
Experience in Database management for Vertica, Teradata, Replication using Orcale Golden Gate, PostgreSQL, Hadoop, BigQuery.
Experience in database installations/Upgrades and Patching.
Experience in Database migration from Oracle to Vertica/Teradata.
Database migration experience from On-Premise to AWS / GCP.
Cloud Platforms: Google Cloud Platform (GCP), AWS, Azure basic knowledge
Cloud Services: Compute Engine, Data flow, Pub/Sub, Dataproc, Cloud Composer, GCS, Jenkins, Armada, Cloud Monitoring & Logging, IAM, VPC, EBS Volumes, AWS EC2, EFS, AWS S3, AWS RDS
Database Platforms: BigQuery, PostgreSQL, Vertica , Teradata, DB2 (LUW/ZoS)
Tools: pgAdmin, psql, Teradata Studio, BigQuery Console, Vertica Management Console, vsql
Performance Tuning: Query optimization, indexing, partitioning, vacuuming, compression, clustering
Backup & Recovery: Point-in-Time Recovery (PITR), WAL archiving, logical backups, Teradata ARC, VBR Backups
High Availability: Streaming replication, logical replication, Vertica K-Safety, Teradata Clustering
Operating Systems: Linux (CentOS, Red Hat), Windows Server
Led SRE efforts during the migration of critical production systems from on-premise data centers to GCP, ensuring high availability, observability, and minimal downtime through automated deployment pipelines and robust monitoring.
Built and optimized Infrastructure as Code (IaC) using Terraform to provision and manage scalable GCP resources; integrated CI/CD pipeline, Cloud Composer etc.
Migration of Vertica to PostgreSQL and BigQuery
- Led the migration of a 30TB Vertica database to PostgreSQL and Google BigQuery,reducing query execution times by 60% and infrastructure costs by 30%.
- Implemented partitioning and clustering strategies in BigQuery to optimize query performance and reduce costs.
Migration from Orcale to Vertica
- Led the Migration of Oracle to Vertica database migration optimizing the BI reporting upto 90%.
- Migrated On-Prem Vertica DB to AWS.
- Automated AWS Infra creation using yaml cfts.
DB2/Vertica/Hadoop/Teradata Application DBA
- Worked as a application DBA for DB2 on Linux, Mainframes, Vertica and Hadoop.
- Worked for different projects with primary role as DB management, performance tuning.