Llama 3.2 3B Instruct
Small, fast, runs on almost anything
Install with Bobbin
Don't have the app? Download it here.
Meta's compact instruct model. The safe first download: it loads in seconds, fits comfortably on 6GB cards, and is genuinely useful for summarising, drafting and quick questions.
Pick something larger if you want deeper reasoning or code.
Available versions
Memory needed grows with the length of a conversation, so these figures are for the context shown. Anything marked est. is worked out from the file size rather than measured on real hardware — the app says so there too. The desktop app checks all of it against your actual machine before installing.