Navin Kumar

• Built a web service that can handle over 120 million RPM during the IPL.
• Developed an end-to-end reporting pipeline for high-throughput analytics.
• Implemented user-based targeting features, including Geo, NCCS, demographics, and more.

Working on a client OTT platform in the big data domain, mostly involving Spark, Hive, AWS, Scala, Java, Spring Boot, and AWS Terraform.

Roles and responsibilities:

• Created a QC framework to check for data anomalies, which helped in prior anomaly detection in reporting data.
• Worked on Adtech, and built a reporting pipeline.

Worked with client DBS - Development bank of Singapore (DBS)

Roles and Responsibility:

• Built and optimized big data pipelines using Spark (Core & SQL), Scala, Hive, Alluxio, and Airflow on Cloudera.
  Handled 3TB+ data analysis with Spark and Hive; improved performance via architecture tuning.
  Automated Spark SQL vs Alluxio benchmarking; visualized results on Grafana Dashboards.
  Conducted R&D on Presto, comparing performance with Hive.

Bedrock is a data management platform that allows the customer to create, manage and govern data lake by providing a simplified interface for ingesting, organize, prepare and govern data over Hadoop.

Roles and Responsibilities:

• Led R&D on Ranger and Sentry to integrate security tools into Bedrock.
• Contributed to Bedrock's transformation engine using Spark and Spark SQL.
• Collaborated with the Architect to revamp all REST APIs to be fully RESTful.
• Implemented RBAC-based security for Bedrock artifacts in coordination with the Architect and Lead.