A private AI assistant that never leaves your computer

Chat, documents, and voice, with nothing sent to the cloud.

How to use this kit

Install Ollama and download a model sized for your computer. Can I Run It will tell you which tools fit.
Add Open WebUI for a full chat interface in your browser.
Drop in your documents so the assistant can answer from them.
Add whisper.cpp to talk to it and Piper to have it talk back.

Chat models4.8

Download and run open language models on your own computer with a single command.

Chat models4.5

A full chat interface for your local models, with documents, search, and multiple users.

Voice4.5

A lightweight version of Whisper that transcribes quickly on ordinary laptops with no graphics card.

Voice3.3

Fast, natural text-to-speech that runs on small devices, even a Raspberry Pi.