Summary
Overview
Work History
Education
Skills
Additional Information
Interests
Timeline
Technical Skills
Technical Skills
Generic
Rakesh Kumar Sharma

Rakesh Kumar Sharma

Lead Engineer
Bangalore

Summary

An accomplished problem solver with more than six years of experience in all levels of Development including performance, function and Integration. Background includes good knowledge of data platform, data pipeline and Reporting pipeline development using Bigdata frameworks, Go-to guy for quick and challenging problems with Excellent troubleshooting and analytical skills, well organized, self-motivated, able to work well with minimal supervision, able to meet deadlines and handle multiple projects and adapts to diverse teams and projects, skilled communicator with good interpersonal skills.


Overview

7
7
years of professional experience
4
4
years of post-secondary education
2
2
Languages

Work History

Lead Engineer

Zeotap India Pvt Ltd
Bangalore
11.2020 - Current
  • ID Unification Platform: Build an ID unification and Identity resolution platform to store complete identity datasets at zeotap across various products (single source of truth) including identity onboarding, resolution and de-linking at scale of 60B+ identity data with average throughput of >900 rps and read and write 300+ MB/s using key value store Scylla, Spark, Airflow and Apache Camel
  • Zeotap Identity Graph: Build 360 degree Identity graph scale of Billion size. across different regions, Was part of core Architecture Design, Data Modelling and implementation of Data Ingestion , Data Cleansing and consumption flow , Build the largest Billion scale Identity Graph of identity data using JanusGraph backed by ScyllaDB, Used Spark Structured Streaming to ingest and consume the data from Janusgraph and gremlin based API to lookup the Graph, And build Reporting Pipeline for analytics on Identity data using spark GraphFrame/GraphX and Google MR based algorithm.
  • Data Onboarding Platform and Revenue Attribution: Lead a team and was involved in the complete architecture, design and implementation for Data Onboarding framework with Data science cleaning and scoring models for identity data we receive from the multiple data partners and ingest them to the final HQ (high quality) store and loopback rejected data for cleaning and process 20+ terabytes of data daily. And Revenue attribution pipeline for 100+ data partners sharing the data based on the priority, contract type and weight matrix of the partners on the delta and net new datasets

Senior Software Engineer

Zeotap India Pvt Ltd
Bangalore
10.2017 - 11.2020


  • GDPR - Sensitive data Management System (Compliance Policy Store): As per the Europe GDPR (General Data Protection Regulation) is a regulation in EU law on data protection and privacy of data used for monetization, We build a Compliance Framework and Policy store using Spark, Scala and Elasticsearch to clean the entire data on a daily basis and apply the required rules provided by GDPR
  • AWS Cost Optimization system (Cloud Miser): This is the system we build for AWS cost optimization and control on Infra spending, This includes Instance recommendations for already running instances using their usage data and able to reduce cost up to 40% on various AWS services. This system includes the AWS RI recommendation and transparency across the infrastructure (Which product spending how much) using tools like AWS Athena, Prometheus and Java.
  • ZeoCore (Core Data Platform at Zeotap): This Zeotap’s core data platform controls the end to end flow of data into the system. This includes all the ETL Pipelines for Data Transformation related work from the raw datasets to monetizable data provided by data partners including Telco partners having 50+ Billion users having more than 300 distinct Attributes. And able to handle various types of data transformation, Data Enrichment, data cleaning and data merging happen through this platform
  • Developed, implemented, supported and maintained data analytics protocols, standards and documentation.
  • Analyzed complex data and identified anomalies, trends and risks to provide useful insights to improve internal controls across various data platforms at Zeotap.

Software Engineer

Minjar Cloud Solutions Pvt Ltd
Bangalore, India
10.2014 - 01.2017
  • IQ Recommendation System for HUL: This is the Product to various outlet recommendation system, Which provides the recommendation to the Distributors the quantity and type of product to be sold to different outlets across the country and provide the sales insight to the management for marketing and other ROI calls using tech stack of AWS Redshift, RestAPI in Java, VBA Macros and SQL Server other few other AWS services
  • Click Stream Analytics System for Redbus India: This product shows the real-time insights and customer funnel analytics for the users on their website/Apps and handling an average of 10k+ unique users/sec. This shows the real-time demand and analysis of users visiting their websites/App like what user is selecting and on which page etc. This product is used for real-time demand and help in real-time decisions for user experience using AWS services like Kinesis, S3, EMR and Java
  • Television Advertisement Ad-Spots recommendation System for GroupM: We build a television advertisement spots recommendation system based on channel popularity, ratings and TRP for a given type of Ads. This is the Big data problem of calculating TV ad spots best suitable for Ads based on its category and TRP and GRP of the channel and the TV program for ~500M+ users watching more than 5k channels and programs. Using tech stack - Java spring framework, Hadoop MapReduce, AWS EMR, MySQL other AWS services

Education

Bachelor of Engineering - Computer Science and Engineering

Government Engineering College
Patan, Gujarat
05.2010 - 05.2014

Skills

    Problem-Solving

undefined

Additional Information

  • Extra-Curricular Achievements , Rajya Puraskar Award in Bharat scout and Guide and International Jamboree award winner across all the countries.

Interests

Bike Riding, Trekking, Traveling to new places, Listening to music

Timeline

Lead Engineer

Zeotap India Pvt Ltd
11.2020 - Current

Senior Software Engineer

Zeotap India Pvt Ltd
10.2017 - 11.2020

Software Engineer

Minjar Cloud Solutions Pvt Ltd
10.2014 - 01.2017

Bachelor of Engineering - Computer Science and Engineering

Government Engineering College
05.2010 - 05.2014

Technical Skills

  • Big Data Frameworks and Services: Apache Spark, JanusGraph, Airflow, Apache Camel, Apache Oozie, Hive, Presto, Kafka and Grafana, Spark GraphX/Graphframe,. AWS/GCP Services BigQuery, Redshift, EMR, Athena, Kinesis, S3, DataProc, GCS and others
  • Programming Languages: Java, Scala, Python, Bash/Shell Scripting Language, SQL
  • Databases: Scylla, JanusGraph, MySQL, Postgres, BigQuery, Redshift, Aerospike
  • Development Tools: Maven, Gradle, Git, IntelliJ

Technical Skills

  • Big Data Frameworks and Services: Apache Spark, JanusGraph, Airflow, Apache Camel, Apache Oozie, Hive, Presto, Kafka and Grafana, Spark GraphX/Graphframe,. AWS/GCP Services BigQuery, Redshift, EMR, Athena, Kinesis, S3, DataProc, GCS and others
  • Programming Languages: Java, Scala, Python, Bash/Shell Scripting Language, SQL
  • Databases: Scylla, JanusGraph, MySQL, Postgres, BigQuery, Redshift, Aerospike
  • Development Tools: Maven, Gradle, Git, IntelliJ

Similar Profiles

CREATE PROFILE
Rakesh Kumar SharmaLead Engineer