llamafile

A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

Distribute and run llamafile/LLMs with a single docker image.

AI Toolkit for Node.js (LLM, Image Generation, Embeddings, Vector Search)

AI Appliance Builder - YAML-defined AI agents and workflow pipelines. Ship as Docker, K8s, ISO, or a single binary.

Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge bases in one click, without complex configuration.

A simple github actions script to build a llamafile and uploads to huggingface

Portable offline AI kit on a USB SSD — run LLM chat + Wikipedia + encrypted vault anywhere. No internet, no install, no subscriptions. Windows/macOS/Linux/Android/iOS. Powered by Qwen3 + llamafile.

Serverless AI Inference with Gemma 2 using Mozilla's llamafile on AWS Lambda

This repository demonstrates LLM execution on CPUs using packages like llamafile, emphasizing low-latency, high-throughput, and cost-effective benefits for inference and serving.

API Proxy for AI models, rate limiting, management and more!

An offline knowledge library on a USB drive. Wikipedia, Stack Exchange, Gutenberg, and Khan Academy, plus a local LLM that answers questions using those sources as context. Works on any computer, no internet required.

👾 Self-Healing AI Terminal Assistant — 100% local, offline-capable, privacy-first. Multi-tier LLM (llamafile/GGUF), auto-fix with FixNet consensus, 80+ commands. No cloud, no API keys needed.

Gathering insights from Common Crawl using Apache Spark and LLMs.

Training materials on how to deploy generative AI models locally on your laptop or workstation.

Deterministic local-first AI operator runtime with receipts, replay, rollback, ranked memory, llamafile CPU driven execution, swappable intelligence cognition core, and sandboxed self-improvement.

Run a fully private, offline AI assistant from a USB flash drive — no installation, no internet, no admin rights required.

UAE / Saudi LLM llamafile — Single-file, no-install executables for Falcon, Jais, ALLaM, and more.