Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.
nodejs python typescript llama whisper ai-sdk on-device-ai stable-diffusion local-llm llm-inference local-ai open-source-llm open-source-ai decentralized-ai open-source-rag openai-compatible local-fine-tuning run-llm-locally p2p-ai open-source-speech-to-text
-
Updated
Sep 12, 2026 - TypeScript