The city of free, open AI tools My Stack
ForkopolisThe free store and magazine for open AI

Chat models

11 free, open tools in this district.

All districtsVideoImagesMusicVoiceChat modelsCodingAgents and workflowsTraining
Set my computer's specs
Ollama screenshot
Chat models4.8

Ollama iconOllama

Download and run open language models on your own computer with a single command.

  • Easy install
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
llama.cpp screenshot
Chat models4.8

llama.cpp iconllama.cpp

The engine under many local AI apps. Runs language models efficiently on almost any hardware.

  • For tinkerers
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
AnythingLLM screenshot
Chat models4.6

AnythingLLM iconAnythingLLM

Chat with your own documents using any model, local or cloud, in one desktop app.

  • Easy install
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights or paid services
Runs
Your computer or the cloud
Real cost
Free
Get it
Open WebUI screenshot
Chat models4.5

Open WebUI iconOpen WebUI

A full chat interface for your local models, with documents, search, and multiple users.

  • Some setup
  • Windows · Mac · Linux
Code
Open source
Models
Open weights or paid services
Runs
On your computer
Real cost
Free
Get it
LocalAI screenshot
Chat models4.5

LocalAI iconLocalAI

A drop-in local replacement for cloud AI services, for text, images, and audio.

  • Some setup
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
LibreChat screenshot
Chat models4.5

LibreChat iconLibreChat

One chat interface for many AI providers and local models, which you host yourself.

  • Some setup
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights or paid services
Runs
Your computer or the cloud
Real cost
Free app, usage fees vary
Get it
Text Generation WebUI screenshot
Chat models4.4

Text Generation WebUI iconText Generation WebUI

A feature-packed interface for running and tuning local language models, popular with tinkerers.

  • Some setup
  • Windows · Mac · Linux
Code
Open source, AGPL-3.0
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
SillyTavern screenshot
Chat models4.4

SillyTavern iconSillyTavern

A highly customizable chat front end for character and story conversations.

  • Some setup
  • Windows · Mac · Linux
Code
Open source, AGPL-3.0
Models
Open weights or paid services
Runs
Your computer or the cloud
Real cost
Free app, usage fees vary
Get it
Jan screenshot
Chat models4.2

Jan iconJan

A clean desktop app for chatting with local models, built as an offline alternative to ChatGPT.

  • Easy install
  • Windows · Mac · Linux
Code
Open source
Models
Open weights or paid services
Runs
On your computer
Real cost
Free
Get it
KoboldCpp screenshot
Chat models4.1

KoboldCpp iconKoboldCpp

A single-file program for running local models, favored for story writing and role play.

  • Easy install
  • Windows · Mac · Linux
Code
Open source, AGPL-3.0
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
GPT4All screenshot
Chat models4.1

GPT4All iconGPT4All

A desktop chat app that runs models privately on your computer and can read your local files.

  • Easy install
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights
Runs
On your computer
Real cost
Free
Get it