The city of free, open AI tools My Stack
ForkopolisThe free store and magazine for open AI

Free Market

Free AI tools to chat with my documents

The best free, open-source AI tools to chat with my documents are AnythingLLM, Open WebUI, Khoj, and RAGFlow. Each one is free, scored, and labeled with what it takes to run.

I want to…
make AI videogenerate imagesupscale or restore a photoremove a backgroundtranscribe audio or videoturn text into speechclone or change a voicemake musicchat with AI privatelychat with my documentswrite code with AIbuild an AI agent or workflowtrain or fine-tune a modelwrite stories or role-play
Set my computer's specs
AnythingLLM screenshot
Chat models4.6

AnythingLLM iconAnythingLLM

Chat with your own documents using any model, local or cloud, in one desktop app.

  • Easy install
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights or paid services
Runs
Your computer or the cloud
Real cost
Free
Get it
Open WebUI screenshot
Chat models4.5

Open WebUI iconOpen WebUI

A full chat interface for your local models, with documents, search, and multiple users.

  • Some setup
  • Windows · Mac · Linux
Code
Open source
Models
Open weights or paid services
Runs
On your computer
Real cost
Free
Get it
Khoj screenshot
Agents and workflows4.3

Khoj iconKhoj

A personal AI that searches your notes and documents and can run research on a schedule.

  • Some setup
  • Windows · Mac · Linux
Code
Open source, AGPL-3.0
Models
Your choice, open or paid
Runs
Your computer or the cloud
Real cost
Free to self-host
Get it
RAGFlow screenshot
Agents and workflows4.7

RAGFlow iconRAGFlow

A document question-answering system that handles complex layouts like tables and scans.

  • For tinkerers
  • Windows · Mac · Linux
Code
Open source, Apache-2.0
Models
Your choice, open or paid
Runs
Your computer or the cloud
Real cost
Free to self-host
Get it
GPT4All screenshot
Chat models4.1

GPT4All iconGPT4All

A desktop chat app that runs models privately on your computer and can read your local files.

  • Easy install
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights
Runs
On your computer
Real cost
Free
Get it
Docling screenshot
Agents and workflows4.6

Docling iconDocling

Converts PDFs, Word files, and slides into clean text that AI tools can read accurately.

  • Some setup
  • Windows · Mac · Linux
Code
Open source, MIT
Models
Open weights, included
Runs
On your computer
Real cost
Free
Get it
MarkItDown screenshot
Agents and workflows4.9

MarkItDown iconMarkItDown

Turns almost any file, from spreadsheets to audio, into plain text ready for an AI model.

  • Some setup
  • Windows · Mac · Linux
Code
Open source, MIT
Models
None needed
Runs
On your computer
Real cost
Free
Get it