Summary
Overview
Work History
Education
Skills
Certification
Personal Information
Projects
Timeline
Hi, I’m

Kanishk Jadhav

Bengaluru
Kanishk Jadhav

Summary

Experienced Data Engineer with a strong track record in designing and optimizing scalable data pipelines. Proficient in cloud technologies including Azure Databricks and BigQuery, with expertise in SQL query optimization and data migration strategies. Skilled in leading projects from inception to completion, ensuring high-quality deliverables that meet business objectives. Passionate about leveraging technology to drive efficiency and deliver actionable insights.

Overview

3
years of professional experience
3
Certification

Work History

Databricks

Data Engineer IV
05.2024 - Current

Job overview

  • Developed ingestion pipelines using Azure Databricks, Pyspark and Fivetran to transfer data from Salesforce to Delta Lake, implementing medallion architecture
  • Evaluated Databricks' internal LakeFlow connector against Fivetran for Salesforce ingestion using A/B testing
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability

Rakuten

Big Data Engineer
01.2022 - 04.2024

Job overview

Received excellence award for outstanding efforts in SPDB 2.0 migration project by SVP, Data Platform Department

  • Designed and developed scalable and efficient ETL pipelines for petabyte scale ingestion from various sources and transform it for downstream consumption using Kafka, Kafka Connect, Spark, MinIO, Airflow, HDFS and Hive
  • Designed and developed pipelines on cloud infrastructure using GCS and BigQuery for consumption of different users
  • Collaborated with cross-functional teams, including data analysts, devOps engineers, DBAs, and business stakeholders to ensure successful deployment of the data pipelines in production
  • Spearheaded the development of comprehensive DataMart, designed to support cross-usage analytics for 20+ Rakuten services by leveraging BigQuery using ELT strategy
  • Monitored and managed the data delivery of Brandmart, a brand data production mart for monetizing the sales data
  • Experience in Trino/Presto to help BUs by enabling more faster and flexible querying of data across multiple data sources
  • Translated and validated over 10,000 SQL queries for business users during the DWH migration from Teradata to BigQuery
  • Averted financial risk of Teradata renewal by independently completing 34% of SQL migration—exceeding the 10% target—in less than half the proposed time.
  • Worked in an Agile development environment to deliver projects on time and meet business requirements.
  • Evaluated emerging big data technologies to ensure relevance with evolving industry trends, maintaining competitive advantage over peers.

H&R Johnson

Software Developer
05.2020 - 07.2020

Job overview

Received a Letter of Recommendation from General Manager for exemplary performance during the internship

  • Developed a mobile application using Flutter to sell merchandise and provide online support for the company agents
  • Integrated the application with Google Cloud platform for cloud messaging and retrieving real-time data
  • Trained and implemented a Chatbot on the application using Google's Dialogflow agent for 24x7 customer support.
  • Improved software efficiency by troubleshooting and resolving coding issues.

Education

Indian Institute of Technology, Bombay (IIT)
Mumbai, India

B.Tech from Civil Engineering
08.2021

University Overview


  • 8.13 CGPA

Skills

  • SQL
  • Python
  • Spark, Pyspark
  • Scala
  • BigQuery
  • GCP
  • Azure Databricks
  • MySQL
  • Airflow
  • Hadoop
  • Kafka/Kafka Connect
  • Data Pipeline Design
  • CI/CD github

Certification

  • Statistics and R offered by HarvardX University
  • Machine Learning with Python by IBM
  • Technical head of Inter-IIT Cultural Meet 2019 supervised by Institute Cultural Council, IIT Bombay

Personal Information

Date of Birth: 10/14/99

Projects

Facial Recognition for Department | Prof. Indu J | 07/19, 11/19

  • Developed an algorithm to perform real-time facial recognition by using the OpenCV library to enhance security in labs
  • Built a training model and classified images based on widely used Local Binary Pattern Histogram algorithm
  • Tested the program in mock trials for use in department labs with a limited dataset and achieved 80% accuracy


SQL Querying on Spatial Database | Prof. Durbha | 01/19, 04/19

  • Generated spatial database in PostgreSQL and performed spatial query on it for classifying the US state regions
  • Analyzed shapefile data and used QGIS to display the graphical results obtained using SQL and QGIS query


Culturals@IITB Mobile App | 09/19, 02/19

  • Designed, developed and deployed the mobile application using Flutter to publicize and conduct events
  • Implemented Facebook login using the Graph API in the application for a personalized user experience. Successfully launched the mobile application on the Google Play Store platform with a reach of 500+ downloads

Timeline

Data Engineer IV

Databricks
05.2024 - Current

Big Data Engineer

Rakuten
01.2022 - 04.2024

Software Developer

H&R Johnson
05.2020 - 07.2020

Indian Institute of Technology, Bombay (IIT)

B.Tech from Civil Engineering

Similar Profiles

CREATE PROFILE
Kanishk Jadhav