SUDIPTA KAR

• Extended real-time 1P ads system for canada (Kafka, Flink, RabbitMQ).
• Designed & automated the ML model deployment cycle using customized Airflow operators, AWS, MLflow, & Jenkins - eliminating 2 hrs of daily manual work across teams (~25% effort reduction).
• Built an API-driven microservice, integrating ML models for spam comment detection.
• Productionized the open-source druid-grafana plugin with custom features and real-time business health alerting.
• Engineered high-performance complex ETLs on AWS EMR using Spark, processing over 10M daily events.

• Developed a customized AWS Fleet operator in Airflow, optimizing EMR job execution and reducing overall runtime and compute cost by 30%.
• Architected an hourly ETL pipeline that ingests data from Snowflake, computes user insight metrics over rolling 7, 14, 30, & 365 days window, and publishes metric deltas to consumers via RabbitMQ
• Led the enhancement and upgradation of the Grafana application used for data visualization & monitoring across organization
• Developed an API-based microservice to detect duplicated listings, improving data integrity and reducing marketplace abuse.

• Migrated on-prem datasets to Azure Data Lake, optimizing ingestion and transformation.
• Cut Spark SQL latency by 40% via data modeling & partitioning in Databricks and built Power BI dashboards with 100+ KPIs.
• Optimized ETL processes while ensuring high data quality standards

Tech: Azure, Databricks, Power BI, DAX, SSMS, SSAS, SQL, Python

• Integrated Nuxeo with AEM for seamless content management & enabled large asset uploads via AWS S3. Customized Nuxeo’s UI, developed reusable components using Polymer.js & jQuery.

Tech: Java, AEM, Nuxeo, AWS S3, MongoDB, Polymer.js

• Worked on “Information security & GRC Automation using archer Tool”.Learned basics of Information security & ISO 27001,Data privacy,regulatory compliances,PCI-DSS,SOX