Blazing fast LLMs API Gateway written in Go ⚡️
Token Bank — the local LLM gateway that sits between your AI agents and every provider. Know where tokens go · Spend less with smart routing to Ollama, Groq, GitHub Models · Earn by sharing idle quota on a community P2P network. One-click onboarding for Cursor, Claude Code, Codex CLI, Gemini CLI — no agent changes. Full trace, seamless model swap
企业级的数字员工容器化管理平台
LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).
One local gateway for every AI provider. Speaks both the Anthropic and OpenAI wire protocols — streaming, tool calling, vision, automatic failover, circuit breakers, and a live dashboard. Works with Claude Desktop, Claude Code, Cursor, Cline, and any SDK. Self-hosted, zero telemetry.
💸 Stop paying for Cursor's AI. Route it through free OpenRouter models or your own API key in 30 seconds — cloud-only, secure, and works on every Linux distro.
Jinguzhou (紧箍咒 [jǐn gū zhòu], Band-tightening Spell): OpenAI-compatible LLM gateway and policy engine for AI agents, tool calling, audit logs, human approval, and MCP or LangChain integrations.
Self-hosted AI/LLM gateway built with Java & Spring Boot for running open-source LLMs locally via llama.cpp, with RAG, AI agents, vision, embeddings, web search, RBAC, and a React playground.
OpenAI 兼容的 AI 大模型网关：一个 API Key 调用所有大模型，智能路由降本，实时可观测，故障自动降级。
Reference Docker Compose stacks, cloud deploy recipes, and SDK integration samples for the DVARA LLM Gateway
Cost-aware, OpenAI-compatible LLM gateway that routes requests across Ollama, OpenAI, Azure and other providers based on complexity, quality, latency and budget.
To associate your repository with the llm-gateway-system topic, visit your repo's landing page and select "manage topics."