The city of free, open AI tools My Stack
ForkopolisThe free store and magazine for open AI

Free Market

Free AI tools to chat with AI privately

The best free, open-source AI tools to chat with AI privately are Ollama, Jan, GPT4All, and Open WebUI. Each one is free, scored, and labeled with what it takes to run.

I want to…
make AI videogenerate imagesupscale or restore a photoremove a backgroundtranscribe audio or videoturn text into speechclone or change a voicemake musicchat with AI privatelychat with my documentswrite code with AIbuild an AI agent or workflowtrain or fine-tune a modelwrite stories or role-play
Set my computer's specs
Ollama screenshot
Chat models4.8

Ollama iconOllama

Download and run open language models on your own computer with a single command.

  • Easy install
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
Jan screenshot
Chat models4.2

Jan iconJan

A clean desktop app for chatting with local models, built as an offline alternative to ChatGPT.

  • Easy install
  • Windows · Mac · Linux
Code
Open source
Models
Open weights or paid services
Runs
On your computer
Real cost
Free
Get it
GPT4All screenshot
Chat models4.1

GPT4All iconGPT4All

A desktop chat app that runs models privately on your computer and can read your local files.

  • Easy install
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
Open WebUI screenshot
Chat models4.5

Open WebUI iconOpen WebUI

A full chat interface for your local models, with documents, search, and multiple users.

  • Some setup
  • Windows · Mac · Linux
Code
Open source
Models
Open weights or paid services
Runs
On your computer
Real cost
Free
Get it
KoboldCpp screenshot
Chat models4.1

KoboldCpp iconKoboldCpp

A single-file program for running local models, favored for story writing and role play.

  • Easy install
  • Windows · Mac · Linux
Code
Open source, AGPL-3.0
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
llama.cpp screenshot
Chat models4.8

llama.cpp iconllama.cpp

The engine under many local AI apps. Runs language models efficiently on almost any hardware.

  • For tinkerers
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
Text Generation WebUI screenshot
Chat models4.4

Text Generation WebUI iconText Generation WebUI

A feature-packed interface for running and tuning local language models, popular with tinkerers.

  • Some setup
  • Windows · Mac · Linux
Code
Open source, AGPL-3.0
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
LocalAI screenshot
Chat models4.5

LocalAI iconLocalAI

A drop-in local replacement for cloud AI services, for text, images, and audio.

  • Some setup
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights
Runs
On your computer
Real cost
Free
Get it