Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

VIJAIKUMAR S

Chennai

Summary

Experienced Engineering Manager with 11 years of proven success in leading high-performing data engineering and Devops teams. With over a decade of broad expertise in IT, I have successfully designed, developed, and implemented numerous applications within the realms of Big Data and AWS environments. Strong technical expertise in data technologies, coupled with excellent leadership and communication skills.

Overview

12
12
years of professional experience
1
1
Certification

Work History

Engineering Manager

Comcast India
Chennai
04.2023 - Current
  • Responsible for mentoring a 15-member team of 6 Data Engineers, 5 Devops Engineers and 4 Automation Testers
  • Implemented a Canary deployment approach in Kubernetes to successfully deploy a production-ready ML model and compared the Metrics in Grafana
  • Established MLOps pipelines for seamless creation and deployment of new releases, streamlining the deployment process
  • Spearheaded the adoption of DevOps practices, enabling continuous integration and deployment of data pipelines, reducing development cycle times for MLOPS and AIOPS teams
  • Managed AWS budgets and cost optimization initiatives, resulting in $5k/month in overall infrastructure cost.

Development Engineer 4

Comcast India
Chennai
10.2021 - 04.2023
  • Development and deployment of multiple Ingestion Jobs using Databricks
  • Development of REST API using AWS API Gateway
  • Developed Lambdas using Python Boto3 for AWS account monitoring and cost cutting
  • Deployment of multiple DE projects using Terraform in QA and PROD environments
  • Creation of QA and Prod CI/CD pipelines using Concourse.

Development Engineer 3

Comcast India
Chennai
01.2021 - 09.2021
  • Package and Deploy Angular and Node Applications using Docker
  • Deployed the Web application using Route 53, ACM, ALB, Target Group, ECS Task, ECS Service
  • Developed Terraform scripts for AWS services like AWS IAM, S3, ECS Cluster, ECS tasks, ECS Service.

Development Engineer 3

Comcast India
Chennai
01.2020 - 12.2020
  • Design and develop the Data Migration Utility for Migration of objects from Hadoop to Minio Storage
  • Migration of Compute from Spark on Hadoop clusters to Spark on Kubernetes clusters
  • Involved in the creation of Docker file, build an image, and push it to Docker Hub
  • Deployed the image onto a POD for running the spark submit on Kubernetes
  • Created Rest API's using Spring Boot to drive the metadata and trigger the migration
  • Migration involves and event driven approach which would have Data Migration, DDL Migration, Data Validation
  • Deployment of API's onto CloudFoundry.

Module Lead

Sopra Steria
Chennai
06.2019 - 01.2020
  • Support and enhancement of Datastax application
  • Creation of Spark Utilities for data repair in Redshift
  • Development of ETL using Spark to Convert data from Redshift to JSON format
  • Automation of EMR cluster creation and monitoring using Shell script.

IT Analyst

TCS
Chennai
05.2017 - 06.2019
  • Read data from several data sources like MDL (Media Data Lake) by partitions, AWS S3, Postgres RDS
  • Create user defined methods for data processing/transformation
  • Process and transform the data for aggregation using Spark SQL or Spark API's
  • Write the data to S3 in the form of CSV and parquet with partitions
  • Optimized the code which brought down the run time from 6hrs to 2hrs
  • Database migration (Oracle/Sybase/SQL to Postgres) and replication setup using AWS DMS.

Assistant Systems Engineer

TCS
Chennai
08.2012 - 04.2018
  • Troubleshoot job failures and ensure quality and timeliness of the deliverables
  • Provide permanent fixes to frequently occurring issues/system bugs in production environment
  • Resolve client data requests and provided the necessary information in a timely manner.

Education

Bachelor of Technology: Electronics and Communication Engineering -

Pondicherry Engineering College
05.2012

Skills

  • HDFS
  • Hive
  • Spark
  • Scala
  • Minio
  • Docker
  • Kubernetes
  • Databricks
  • Spring Boot
  • Shell scripting
  • AWS
  • Concourse CI/CD
  • Terraform
  • Oracle
  • Postgres
  • Redshift
  • GIT

Certification

  • HashiCorp Certified: Terraform Associate
  • ITIL Certified

Timeline

Engineering Manager

Comcast India
04.2023 - Current

Development Engineer 4

Comcast India
10.2021 - 04.2023

Development Engineer 3

Comcast India
01.2021 - 09.2021

Development Engineer 3

Comcast India
01.2020 - 12.2020

Module Lead

Sopra Steria
06.2019 - 01.2020

IT Analyst

TCS
05.2017 - 06.2019

Assistant Systems Engineer

TCS
08.2012 - 04.2018

Bachelor of Technology: Electronics and Communication Engineering -

Pondicherry Engineering College

Similar Profiles

CREATE PROFILE
VIJAIKUMAR S