SUDIPTA KAR

• Collaborated with DS team & built a Flask-based REST API microservice, integrating ML models for spam comment detection, processing 300K events daily with p99 latency of 200 ms.
• Designed the ML model deployment cycle using customized Airflow operators, AWS, MLflow, & Jenkins, enabling automated model training, versioning and deployment while reducing operational effort by 25%.
• Extended real-time 1P ads system for the Canada region (Kafka, Flink, RabbitMQ).
• Productionized the open-source druid-grafana plugin with custom features and real-time business health alerting.
• Collaborating with Product Manager, Server & analytics team to define event-stream taxonomy, evaluate pipeline scalability, and ensure analytics readiness before a new feature launches.
• Mentoring junior engineers on Spark, Airflow, and distributed systems.

• Developed a custom Airflow operator, for dynamic AWS EMR cluster provisioning, improving pipeline reliability while reducing compute costs by 30%.
• Developed an embedding-based duplicate listing detection service that leveraged cosine similarity search against millions of precomputed listing embeddings, improving marketplace integrity and reducing abusive reposting.
• Architected an hourly analytics pipeline that ingested Snowflake datasets, computes rolling user-engagement metrics over 7, 14, 30, and 365-day windows, and published incremental updates via RabbitMQ to power near real-time insights in seller-facing product experiences.
• Led the enhancement and upgradation of the Grafana application used for data visualization & monitoring across organization

• Migrated on-prem datasets to Azure Data Lake, optimizing ingestion and transformation.
• Cut Spark SQL latency by 40% via data modeling & partitioning in Databricks and built Power BI dashboards with 100+ KPIs.
• Optimized ETL processes while ensuring high data quality standards

Tech: Azure, Databricks, Power BI, DAX, SSMS, SSAS, SQL, Python

• Integrated Nuxeo with AEM for seamless content management & enabled large asset uploads via AWS S3. Customized Nuxeo’s UI, developed reusable components using Polymer.js & jQuery.

Tech: Java, AEM, Nuxeo, AWS S3, MongoDB, Polymer.js

• Worked on “Information security & GRC Automation using archer Tool”.Learned basics of Information security & ISO 27001,Data privacy,regulatory compliances,PCI-DSS,SOX