| Model | Params | Quant | Min RAM ↑ | Load | Best for | Deploy |
|---|---|---|---|---|---|---|
SmolLM2 360M SmolLM | 0.4B | Q4_K_M | 1 GB | 0.5 GB | Localopen | |
Llama 3.2 1B Instruct Llama | 1B | Q4_K_M | 2 GB | 1 GB | Localopen | |
Qwen2.5 0.5B Instruct Qwen | 0.5B | Q4_K_M | 2 GB | 0.8 GB | Localopen | |
Gemma 3 1B Instruct Gemma | 1B | Q4_K_M | 2 GB | 1 GB | Localopen | |
Qwen3.5 0.8B Instruct Qwen | 0.8B | Q4_K_M | 2 GB | 0.8 GB | Localopen | |
Qwen2.5 1.5B Instruct Qwen | 1.5B | Q4_K_M | 4 GB | 1.5 GB | Localopen | |
Qwen2.5 3B Instruct Qwen | 3B | Q4_K_M | 4 GB | 2.5 GB | Localopen | |
Llama 3.2 3B Instruct Llama | 3B | Q4_K_M | 4 GB | 2.5 GB | Localopen | |
Gemma 2 2B Instruct Gemma | 2B | Q4_K_M | 4 GB | 1.8 GB | Localopen | |
Qwen3.5 2B Instruct Qwen | 2B | Q4_K_M | 4 GB | 1.8 GB | Localopen | |
Granite 4.1 3B Instruct Granite | 3B | Q4_K_M | 4 GB | 2 GB | Localopen | |
Gemma 4 E2B Gemma | 2.3B | Q4_K_M | 4 GB | 2.3 GB | Localopen | |
Phi-3 Mini 3.8B Phi | 3.8B | Q4_K_M | 6 GB | 3.2 GB | Localopen | |
Phi-4 Mini 3.8B Phi | 3.8B | Q4_K_M | 6 GB | 3.2 GB | Localopen | |
Gemma 3 4B Instruct Gemma | 4B | Q4_K_M | 6 GB | 3.5 GB | Localopen | |
Qwen3.5 4B Instruct Qwen | 4B | Q4_K_M | 6 GB | 3.5 GB | Localopen | |
Gemma 4 E4B Gemma | 4.5B | Q4_K_M | 6 GB | 4 GB | Localopen | |
Qwen2.5 7B Instruct Qwen | 7B | Q4_K_M | 8 GB | 5.5 GB | Localopen | |
Mistral 7B Instruct Mistral | 7B | Q4_K_M | 8 GB | 5.5 GB | Localopen | |
Qwen2.5 Coder 7B Qwen | 7B | Q4_K_M | 8 GB | 5.5 GB | Localopen | |
DeepSeek-R1 Distill Qwen 7B DeepSeek | 7B | Q4_K_M | 8 GB | 5.5 GB | Localopen | |
LFM2.5 8B-A1B LFM2 | 8.3B | Q4_K_M | 8 GB | 5.5 GB | Localopen | |
Granite 4.1 8B Instruct Granite | 8B | Q4_K_M | 8 GB | 5.5 GB | Localopen | |
Ornith 1.0 9B Ornith | 9B | Q4_K_M | 8 GB | 5.6 GB | Localopen | |
Llama 3.1 8B Instruct Llama | 8B | Q4_K_M | 12 GB | 6.5 GB | Localopen | |
Llama 3.1 8B Instruct (Q5) Llama | 8B | Q5_K_M | 12 GB | 8 GB | Localopen | |
Gemma 2 9B Instruct Gemma | 9B | Q4_K_M | 12 GB | 7 GB | Localopen | |
Qwen3 8B Qwen | 8B | Q4_K_M | 12 GB | 6.5 GB | Localopen | |
Qwen3.5 9B Instruct Qwen | 9B | Q4_K_M | 12 GB | 7 GB | Localopen | |
Gemma 4 12B Gemma | 12B | Q4_K_M | 12 GB | 8 GB | Localopen | |
Qwen2.5 14B Instruct Qwen | 14B | Q4_K_M | 16 GB | 11 GB | Localopen | |
Mistral Nemo 12B Mistral | 12B | Q4_K_M | 16 GB | 9.5 GB | Localopen | |
Phi-3 Medium 14B Phi | 14B | Q4_K_M | 16 GB | 11 GB | Localopen | |
Qwen2.5 Coder 14B Qwen | 14B | Q4_K_M | 16 GB | 11 GB | Localopen | |
Qwen3 14B Qwen | 14B | Q4_K_M | 16 GB | 11 GB | Localopen | |
Gemma 3 12B Instruct Gemma | 12B | Q4_K_M | 16 GB | 9.5 GB | Localopen | |
DeepSeek-R1 Distill Qwen 14B DeepSeek | 14B | Q4_K_M | 16 GB | 11 GB | Localopen | |
Qwen3.5 9B Instruct (Q8) Qwen | 9B | Q8_0 | 16 GB | 10.7 GB | Localopen | |
Phi-4 14B Phi | 14B | Q4_K_M | 24 GB | 11.5 GB | Localopen | |
Mistral Small 3.1 Mistral | 24B | Q4_K_M | 24 GB | 15 GB | Localopen | |
Qwen3.5 27B Instruct Qwen | 27B | Q4_K_M | 24 GB | 16 GB | Localopen | |
LFM2 24B-A2B Instruct LFM2 | 24B | Q4_K_M | 24 GB | 14 GB | Localopen | |
Qwen3.8 27B Qwen | 27B | Q4_K_M | 24 GB | 16.5 GB | Localopen | |
Gemma 4 26B-A4B Gemma | 26B | Q4_K_M | 24 GB | 16 GB | Localopen | |
GPT-OSS 20B GPT-OSS | 21B | MXFP4 | 24 GB | 13.8 GB | Localopen | |
Gemma 4 12B (Q8) Gemma | 12B | Q8_0 | 24 GB | 12.8 GB | Localopen | |
Qwen3 14B (Q8) Qwen | 14B | Q8_0 | 24 GB | 15.9 GB | Localopen | |
Gemma 2 27B Instruct Gemma | 27B | Q4_K_M | 32 GB | 21 GB | Localopen | |
Mistral Small 22B Mistral | 22B | Q4_K_M | 32 GB | 17 GB | Localopen | |
Qwen3 30B Qwen | 30B | Q4_K_M | 32 GB | 22 GB | Localopen | |
Gemma 3 27B Instruct Gemma | 27B | Q4_K_M | 32 GB | 21 GB | Localopen | |
Qwen3.5 35B-A3B Instruct Qwen | 35B | Q4_K_M | 32 GB | 20 GB | Localopen | |
Qwen3.6 27B Qwen | 27B | Q4_K_M | 32 GB | 18 GB | Localopen | |
Qwen3.6 35B-A3B Qwen | 35B | Q4_K_M | 32 GB | 22 GB | Localopen | |
Gemma 4 31B Gemma | 31B | Q4_K_M | 32 GB | 20 GB | Localopen | |
Cohere North Mini Code North | 30B | Q4_K_M | 32 GB | 19 GB | Localopen | |
Laguna XS 2.1 Laguna | 33B | Q4_K_M | 32 GB | 20.3 GB | Localopen | |
Ornith 1.0 35B Ornith | 35B | Q4_K_M | 32 GB | 21.2 GB | Localopen | |
NVIDIA Nemotron Cascade 2 30B-A3B Nemotron | 30B | Q6_K | 36 GB | 24 GB | Localopen | |
Poolside Laguna XS.2 Laguna | 33B | Q4_K_M | 36 GB | 23 GB | Localopen | |
Mixtral 8x7B Instruct Mistral | 46.7B | Q4_K_M | 48 GB | 30 GB | Localopen | |
Qwen3.6 27B (Q8) Qwen | 27B | Q8_0 | 48 GB | 30 GB | Localopen | |
Gemma 4 26B-A4B (Q8) Gemma | 26B | Q8_0 | 48 GB | 28.1 GB | Localopen | |
Llama 3.1 70B Instruct Llama | 70B | Q4_K_M | 64 GB | 42 GB | Localopen | |
Llama 3.3 70B Instruct Llama | 70B | Q4_K_M | 64 GB | 42 GB | Localopen | |
DeepSeek-R1 Distill Llama 70B DeepSeek | 70B | Q4_K_M | 64 GB | 42 GB | Localopen | |
Qwen3.6 35B-A3B (Q8) Qwen | 35B | Q8_0 | 64 GB | 38.7 GB | Localopen | |
Qwen3.5 35B-A3B Instruct (Q8) Qwen | 35B | Q8_0 | 64 GB | 38.7 GB | Localopen | |
Qwen3-Next 80B-A3B Qwen | 80B | Q4_K_M | 72 GB | 50.4 GB | Localopen | |
Qwen3.5 122B-A10B Instruct Qwen | 122B | Q4_K_M | 96 GB | 72 GB | Localopen | |
Llama 4 Scout Llama | 109B | Q4_K_M | 96 GB | 67 GB | Localopen | |
GPT-OSS 120B GPT-OSS | 117B | MXFP4 | 96 GB | 65.4 GB | Localopen | |
Llama 3.3 70B Instruct (Q8) Llama | 70B | Q8_0 | 96 GB | 75 GB | Localopen | |
Llama 3.3 70B Instruct (Q6) Llama | 70B | Q6_K | 96 GB | 57.9 GB | Localopen | |
Qwen3-Next 80B-A3B (Q8) Qwen | 80B | Q8_0 | 128 GB | 84.8 GB | Localopen | |
Laguna S 2.1 Laguna | 118B | Q4_K_M | 128 GB | 96 GB | Localopen | |
Qwen3 235B A22B Qwen | 235B | Q4_K_M | 192 GB | 130 GB | Localopen | |
Qwen3.8-Flash-Next Qwen | 125B | IQ1_S | 192 GB | 123 GB | Localopen | |
Llama 3.1 405B Instruct Llama | 405B | Q4_K_M | 320 GB | 243 GB | Localopen | |
Llama 4 Maverick Llama | 400B | Q4_K_M | 320 GB | 245 GB | Localopen | |
DeepSeek-R1 671B DeepSeek | 671B | Q4_K_M | 512 GB | 380 GB | Localopen | |
Kimi K2 Instruct Kimi | 1T | API | — | — | Cloudopen | |
Claude 3.5 Sonnet Claude | — | API | — | — | Cloud | |
Claude 3.7 Sonnet Claude | — | API | — | — | Cloud | |
Claude 3 Opus Claude | — | API | — | — | Cloud | |
Claude 4 Opus Claude | — | API | — | — | Cloud | |
GPT-4o OpenAI | — | API | — | — | Cloud | |
GPT-4o mini OpenAI | — | API | — | — | Cloud | |
Claude 4 Sonnet Claude | — | API | — | — | Cloud | |
Gemini 2.5 Pro Google | — | API | — | — | Cloud | |
Gemini 2.5 Flash Google | — | API | — | — | Cloud | |
DeepSeek-V3 DeepSeek | 671B | API | — | — | Cloudopen | |
GLM-5 Zhipu | 744B | API | — | — | Cloudopen | |
GLM-4 Plus Zhipu | — | API | — | — | Cloud | |
DeepSeek-V3-0324 DeepSeek | 671B | API | — | — | Cloudopen | |
DeepSeek-R1 DeepSeek | 671B | API | — | — | Cloudopen | |
Mistral Medium 3.5 Mistral | 128B | API | — | — | CloudopenDIY | |
DeepSeek V4 Flash 0731 DeepSeek | 284B | API | — | — | CloudopenDIY | |
DeepSeek V4 Pro DeepSeek | 1.6T | API | — | — | Cloudopen | |
Kimi K2.6 Kimi | 1T | API | — | — | Cloudopen | |
GLM-5.1 Zhipu | 744B | API | — | — | Cloudopen | |
Claude Opus 4.7 Claude | — | API | — | — | Cloud | |
Claude Opus 4.8 Claude | — | API | — | — | Cloud | |
GPT-5.5 OpenAI | — | API | — | — | Cloud | |
Gemini 3.1 Pro Google | — | API | — | — | Cloud | |
Grok 4.3 xAI | — | API | — | — | Cloud | |
Claude Fable 5 Claude | — | API | — | — | Cloud | |
GLM-5.2 Zhipu | 753B | API | — | — | Cloudopen | |
Kimi K2.7-Code Kimi | 1T | API | — | — | Cloudopen | |
MiniMax M3 MiniMax | 428B | API | — | — | Cloudopen | |
Qwen3.7-Plus Qwen | — | API | — | — | Cloud | |
NVIDIA Nemotron 3 Ultra Nemotron | 550B | API | — | — | Cloudopen | |
Xiaomi MiMo-V2-Flash MiMo | 309B | API | — | — | CloudopenDIY | |
Kimi K3 Kimi | 2.8T | API | — | — | Cloudopen |