Hardware Lab
What AI can you run with 24 GB of VRAM?
A graphics card with 24 GB of memory runs 59 of the 59 tools in the Free Market that work on your own computer. Nothing in the catalog needs more.
For language models, 24 GB holds a model of up to about 33 billion parameters at the common Q4 quality level, entirely on the card, which is the fast way to run it. Bigger models still run if you have enough main memory, but several times slower.
Check a specific model size Check my whole computer
What we measured on a 24 GB card
| Computer | Model | Run with | Task | Speed |
|---|
| GMKtec EVO-X2 with an RTX 3090 | DeepSeek V4.1 Flash
2.00-bit set, 257 GB on disk | Strata | Probability problems
5 of 5 answers correct | 23.8 tokens/s |
| GMKtec EVO-X2 with an RTX 3090 | DeepSeek V4.1 Flash
2.00-bit set, 257 GB on disk | Strata | Power plant scheduling puzzle
6 of 6 checks correct | 27.3 tokens/s |
| GMKtec EVO-X2 with an RTX 3090 | DeepSeek V4.1 Flash
2.00-bit set, 257 GB on disk | Strata | Finding bugs in database code
Found seven bugs | 26.0 tokens/s |
| GMKtec EVO-X2 with an RTX 3090 | DeepSeek V4.1 Flash
2.25-bit set, 274 GB on disk, tuned for accuracy | Strata | Plain-language explanation (two runs)
About 620 tokens each | 20.2 and 24.7 tokens/s |
| GMKtec EVO-X2 with an RTX 3090 | DeepSeek V4.1 Flash
2.25-bit set, 274 GB on disk, tuned for accuracy | Strata | Writing a Python script
2,586 tokens | 21.8 tokens/s |
| GMKtec EVO-X2 with an RTX 3090 | DeepSeek V4.1 Flash
2.25-bit set, 274 GB on disk, tuned for accuracy | Strata | Maths word problem
496 tokens | 22.6 tokens/s |
Single runs on our own computers. See the full test details.
Tools that need a graphics card and fit in 24 GB
A training suite for the newest image and video models, with a simple interface.
- Some setup
- Windows · Linux
- Code
- Open source, MIT
- Models
- Open weights
- Runs
- On your computer
- Real cost
- Free
A large video generation model with high visual quality, for powerful graphics cards.
- For tinkerers
- Windows · Linux
- Code
- Open source
- Models
- Open weights, custom license
- Runs
- On your computer
- Real cost
- Free
An open text-to-video model known for smooth, realistic motion.
- For tinkerers
- Windows · Linux
- Code
- Open source, Apache-2.0
- Models
- Open weights
- Runs
- On your computer
- Real cost
- Free
A high-speed engine for serving language models to many users at once.
- Code
- Open source, Apache-2.0
- Models
- Open weights
- Runs
- On your computer
- Real cost
- Free
A fast video generation model built to produce clips quickly on consumer graphics cards.
- For tinkerers
- Windows · Linux
- Code
- Open source, Apache-2.0
- Models
- Open weights, check license terms
- Runs
- On your computer
- Real cost
- Free
Teach an image model a new style, face, or product from a handful of pictures.
- Some setup
- Windows · Linux
- Code
- Open source, Apache-2.0
- Models
- Open weights
- Runs
- On your computer
- Real cost
- Free
An open video generation model that turns text or a still image into short clips.
- For tinkerers
- Windows · Linux
- Code
- Open source, Apache-2.0
- Models
- Open weights
- Runs
- On your computer
- Real cost
- Free
Build image and video generation workflows by connecting blocks, with full control over every step.
- Some setup
- Windows · Mac · Linux
- Code
- Open source, GPL-3.0
- Models
- Open weights, your choice
- Runs
- On your computer
- Real cost
- Free
Fine-tune language models on your own data, faster and with much less memory.
- For tinkerers
- Windows · Linux
- Code
- Open source, Apache-2.0
- Models
- Open weights
- Runs
- On your computer
- Real cost
- Free
New
Runs very large language models on an ordinary gaming PC by spreading them across the graphics card, memory and SSD.
- Some setup
- Windows · Mac · Linux
- Code
- Open source, MIT
- Models
- Open weights
- Runs
- On your computer
- Real cost
- Free
A polished creative studio for image generation, with a canvas, layers, and tools aimed at artists.
- Easy install
- Windows · Mac · Linux
- Code
- Open source, Apache-2.0
- Models
- Open weights, your choice
- Runs
- On your computer
- Real cost
- Free
Selects and tracks any object through a video from a single click, for masking and effects work.
- For tinkerers
- Windows · Mac · Linux
- Code
- Open source, Apache-2.0
- Models
- Open weights
- Runs
- On your computer
- Real cost
- Free
AI Toolkit
HunyuanVideo
Kohya's GUI
Segment Anything 2
