On-device, real-time multimodal AI. Have natural voice and vision conversations with an AI that runs entirely on your machine. Powered by Gemma 4 E2B and Kokoro.
-
Updated
May 16, 2026 - HTML
On-device, real-time multimodal AI. Have natural voice and vision conversations with an AI that runs entirely on your machine. Powered by Gemma 4 E2B and Kokoro.
Private on-device AI suite for Android. Fork of Google AI Edge Gallery with llama.cpp, whisper.cpp, stable-diffusion.cpp, GGUF import, voice chat, vision AI, on-device image generation, biometric lock, encrypted history, and CPU/NPU/GPU acceleration.
Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.
Turn your Android phone into an OpenAI-compatible LLM inference server — Fully local, private and Open Source
Swift package for running LiteRT-LM models on iOS. Wraps Google's C API in a clean, async/await Swift interface.
Edge Agent Lab is an Android testing platform for evaluating small language model (SLM) agents directly on mobile devices.
Run LLM inference in an Android app with llama.cpp, ExecuTorch, LiteRT, ONNX, and more.
LiteRT-LM model inference support for Unity Android and Meta Quest apps.
Unofficial Swift SDK for Google's LiteRT-LM — run Gemma 4 on-device with text, vision, audio, and tool calling. CPU + GPU (Metal). iOS 17+ / macOS 14+.
Rust bindings for LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization
Agent Skills for on-device ML: FunctionGemma fine-tuning, LiteRT-LM export, and more. Compatible with Claude Code, Codex, and Gemini CLI.
Ash — offline survival assistant for iOS. Gemma 4 E2B/E4B fully on-device (text · image · voice) with RAG-grounded answers over 56 emergency-response packs. Built for the Kaggle Gemma 4 Good Hackathon.
On-device LLM client for Android. Fork of Google AI Edge Gallery
Brain tracker that won't blow smoke up your ass. Gemma 4, Android, fully local.
React Native module for on-device LLM inference using LiteRT/MediaPipe. Supports Gemma 3n and other compatible models with AI SDK compatible API
Open-source voice assistant for Android — Gemma 4 E2B on-device with native audio input and tool calling. A privacy-first alternative to Google Assistant: no cloud, no account, no telemetry.
Add a description, image, and links to the litert-lm topic page so that developers can more easily learn about it.
To associate your repository with the litert-lm topic, visit your repo's landing page and select "manage topics."