Skip to content
AI Stack Nest

Will it run?

Everything to pick, install and run open models on your own computer.

Will it run?

Pick a model, tell the page how much RAM and video memory your computer has, and it estimates whether the model will run on the GPU, run slowly on the CPU, or not fit at all. The estimate is parameters times bytes per weight plus about 1.5 GB of overhead, so treat it as a planning number and leave some headroom for your other programs.

ModelNeeds (est.)Result
Gemma 2 9B6.9 GBRuns on CPU (slow)
Llama 3.1 70B43.5 GBToo big for this PC
Llama 3.1 8B6.3 GBRuns on CPU (slow)
Mistral 7B Instruct v0.35.7 GBRuns on CPU (slow)
Qwen2.5 7B Instruct6.1 GBRuns on CPU (slow)

Estimate: parameters x bytes per weight + about 1.5 GB overhead. Real use depends on context length and software.