Bobbin
← Models

Qwen2.5 7B Instruct

The previous generation's all-rounder

qwenApache-2.0FreeReleased September 2024 · 2 years old
Install with Bobbin

Don't have the app? Download it here.

Superseded by Qwen3 8B, but still widely used and very well understood. A year of people writing guides and fine-tunes for it means more help available if you get stuck.

Choose Qwen3 8B unless you have a reason to want this one.

Available versions

QuantizationSizeVRAMRAMContext
Q4_K_M4.7 GB5.3 GB9.8 GB8kInstall
Q6_K6.3 GB6.7 GB11.7 GB8kInstall

Memory needed grows with the length of a conversation, so these figures are for the context shown. Anything marked est. is worked out from the file size rather than measured on real hardware — the app says so there too. The desktop app checks all of it against your actual machine before installing.