[ACL 2026] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization
ClearML - Model-Serving Orchestration and Repository Solution
SecretFlow-Serving is a serving system for privacy-preserving machine learning models.
MoDM is a cache-aware, hybrid serving system that accelerates image generation by dynamically combining small and large diffusion models for efficient, high-quality output.
A streaming action runtime for AI agents, model serving, and multimodal APIs
An async ML service built with FastAPI, Celery, RabbitMQ, and Redis for efficient, scalable ML model serving
Implementation of an ML Model Serving with Flask, the model is LGBM trained on Kaggle titanic data.
Machine Learning (MLeap) Model Serving application for Scala
Professional Python project: deploying and serving machine learning models.
Predviđanje rezultata telemarketinga
Simple web application developed with streamlit for serving Machine Learning Model
Professional Python project: deploying and serving machine learning models.
Machine-Learning-Project 6
Dhruva is a full-fledged DPG platform for serving AI models at scale.
Applied Machine Learning - Serving
To associate your repository with the serving-ml topic, visit your repo's landing page and select "manage topics."