Summary
Overview
Work History
Education
Skills
Certification
Awards
Years Of Experience
Timeline
Generic

Ganesh Patil

Data and MLOps engineer
Pune

Summary

Data Engineer with a strong background in cloud-based data platforms including GCP, AWS, and Snowflake. Proficient in Apache Spark and Databricks for large-scale data processing. Experienced in managing machine learning operations, productionize models, and building efficient ETL pipelines. Demonstrated success in developing ML models for inventory forecasting and promotional analysis, driving data-driven insights. Accustomed to working closely with system architects, software architects and design analysts to understand business or industry requirements to develop comprehensive data models.

Overview

11
11
years of professional experience
1
1
Certification

Work History

Data Engineer II

Beam Suntory
09.2020 - Current
  • Working as a data engineer and MLOps architect, helps to manage the supply chain data by using GCP services.

Projects:

  • Promo AI: This tool is designed to improve promotion effectiveness with a data-driven approach.
  • Emea-Dts: I am responsible for collecting, harmonizing, and preparing supply chain data from various regions for reporting using Apache Spark and Cloud Run
  • DnA: Helps collect social and analytical data from different services like SFMC, GA360, and MOAT, etc in order to generate the scorecard displaying brand performance
  • Stack: GCP Platform, Snowflake, AWS
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.

Module Lead

Datametica
11.2019 - 09.2020
  • Helps in migrating the project to Google cloud, optimizing the existing spark job, and solving deployment issues.


Projects:

  • Express: Express, Inc : Is an American fashion retailer, This project is about Data warehousing, In which we also perform data enrichments, customer matching, and data deduping using Spark and Hadoop
  • Stack: GCP Platform

Senior Technical Associate

Sears Holdings India
06.2016 - 10.2019
  • Utilized the cloud services like Dataflow, Compute Engine, and BigTable to reduce the cost of maintenance, and increase the robustness and scalability of the application.


Projects:

  • RTS: RTS processes real-time feed from different communication channels and re-scores the propensity score which predicts members' propensity to buy in the particular product category, hence helping generate targeted offers for members
  • Churn Prediction: Retail churn prediction using LightGBM decision tree
  • Used PySpark for distributed scoring in the GCP cloud
  • Stack: GCP Platform, LightGBM

Sr. Software Engineer

Delmon Solution
09.2014 - 06.2016
  • Helps in collecting the HVAC, chillers realtime and batch data, process using the MapReduce and Apache Storm, Finding the anomalies in data.


Projects:

  • EPAO - Extended Platform for Analysis and Opportunity: A management portal designed to provide monitoring of assets like chillers, compressors, etc, by processing the raw sensory outputs
  • The processed data is displayed to the end user in the form of live dashboards for monitoring controllers, fault detection for diagnostics and maintenance, and other various reports
  • SCC - Smart Chiller Connectivity: Developed using Hadoop Ecosystem (Microsoft Azure HDInsight) as main backend support
  • Uses Storm and Azure Stream analytics for processing continuous events of the stream (In JSON) from Azure EventHub
  • The gathered data uses to calculate the alerts, used to show on the live dashboard
  • Stack: Hortanworks, Microsoft Azure, Hadoop

Education

BE - Computer Engineering

Dr. D Y Patil COE
07.2012

SSC - undefined

Residential Jr. College
07.2007

SSC - undefined

Residential High School
07.2005

Skills

  • Google cloud platform
  • Apache Spark
  • Hadoop
  • Apache Airflow/Composer/Astronomer
  • AWS
  • Microsoft Azure
  • Databricks Cloud
  • Snowflake
  • Kubernetes
  • Microservices development
  • Machine Learning
  • Looker

Certification

  • Google cloud certified Professional Data Engineer, Google, 01/20, 01/22, 778e3de6-d6b4-4276-9c2f-5483b0a47399
  • Neural Networks and Deep Learning, Coursera, SM7ESZYKMY4V

Awards

  • Star Performer for performance optimization, 01/18, Sears Holdings India
  • Star Performer for integrating new ML models in existing Pipeline, 08/17, Sears Holdings India
  • Star performer for Migrating existing system in Google Cloud Storage, 03/17, Sears Holdings India
  • Star Developer, 02/15, Delmon Solutions

Years Of Experience

10+ Year

Timeline

Data Engineer II

Beam Suntory
09.2020 - Current

Module Lead

Datametica
11.2019 - 09.2020

Senior Technical Associate

Sears Holdings India
06.2016 - 10.2019

Sr. Software Engineer

Delmon Solution
09.2014 - 06.2016

SSC - undefined

Residential Jr. College

SSC - undefined

Residential High School

BE - Computer Engineering

Dr. D Y Patil COE
Ganesh PatilData and MLOps engineer