Mistral Small 3.2 24B
The most capable model that still fits 16GB
Install with Bobbin
Don't have the app? Download it here.
Mistral's larger open model, and about as much as a 16GB card will hold. Handles long documents and detailed instructions well.
Tight on 16GB — you may need to reduce how much conversation it remembers.
Available versions
| Quantization | Size | VRAM | RAM | Context | |
|---|---|---|---|---|---|
| Q4_K_M | 14.3 GB | 14.0 GBest. | 22.0 GB | 8k | Install |
Memory needed grows with the length of a conversation, so these figures are for the context shown. Anything marked est. is worked out from the file size rather than measured on real hardware — the app says so there too. The desktop app checks all of it against your actual machine before installing.