Bobbin
← Models

Qwen2.5 0.5B Instruct

Tiny and instant — runs on laptops without a graphics card

qwenApache-2.0FreeReleased September 2024 · 2 years old
Install with Bobbin

Don't have the app? Download it here.

The smallest model worth using. It downloads in under a minute, starts instantly, and runs acceptably even with no graphics card at all.

It is not clever — expect short, simple answers and mistakes on anything involving reasoning. Use it to check the app works on a modest machine, or when speed matters more than quality.

Available versions

QuantizationSizeVRAMRAMContext
Q4_K_M398 MB700 MB2.4 GB4kInstall

Memory needed grows with the length of a conversation, so these figures are for the context shown. Anything marked est. is worked out from the file size rather than measured on real hardware — the app says so there too. The desktop app checks all of it against your actual machine before installing.