Known-issues sheets for local language models Rev 0.1.0 · reviewed every 7 days
llm-picker

Full characteristics table

Explore all ratings

One row per model × quant band. Blank cells mean not yet rated — never a guessed score. Click a column header to sort.

Quant band
Model Quant band Needs GB Math Code Tools Facts Instr. Issues
DeepSeek R1-0528 Qwen3-8B Q2–Q3 4 ····· 2 (severe)
DeepSeek R1-0528 Qwen3-8B Q4–Q5 5 ····· 2 (severe)
DeepSeek R1-0528 Qwen3-8B Q6–Q8 7 ····· 2 (severe)
DeepSeek R1-0528 Qwen3-8B FP16 16 86··· 2 (severe)
Gemma 3 12B vis Q2–Q3 6 3···· 2 (severe)
Gemma 3 12B vis Q4–Q5 7 45··7 1 (moderate)
Gemma 3 12B vis Q6–Q8 10 ····· 1 (moderate)
Gemma 3 12B vis FP16 24 55·6· 1 (moderate)
Gemma 3 27B vis Q2–Q3 13 ····· 3 (severe)
Gemma 3 27B vis Q4–Q5 17 44··· 3 (severe)
Gemma 3 27B vis Q6–Q8 22 ····· 3 (severe)
Gemma 3 27B vis FP16 54 54·5· 3 (severe)
Gemma 3 4B vis Q2–Q3 2.1 ····· 2 (severe)
Gemma 3 4B vis Q4–Q5 2.5 34··· 2 (severe)
Gemma 3 4B vis Q6–Q8 3.2 ····· 2 (severe)
Gemma 3 4B vis FP16 7.8 34·5· 2 (severe)
Gemma 4 12B vis Q2–Q3 6 ····· 3 (severe)
Gemma 4 12B vis Q4–Q5 7 666·· 3 (severe)
Gemma 4 12B vis Q6–Q8 10 ····· 3 (severe)
Gemma 4 12B vis FP16 24 777·· 1 (moderate)
Gemma 4 26B-A4B vis Q2–Q3 13 ····· 2 (moderate)
Gemma 4 26B-A4B vis Q4–Q5 14 776·· 2 (moderate)
Gemma 4 26B-A4B vis Q6–Q8 23 ····· 2 (moderate)
Gemma 4 26B-A4B vis FP16 50 887·· 2 (moderate)
Gemma 4 31B vis Q2–Q3 15 ····· 3 (severe)
Gemma 4 31B vis Q4–Q5 18 776·· 3 (severe)
Gemma 4 31B vis Q6–Q8 25 ····· 3 (severe)
Gemma 4 31B vis FP16 61 887·· 2 (moderate)
Gemma 4 E2B vis Q2–Q3 2.5 ····· 3 (severe)
Gemma 4 E2B vis Q4–Q5 3.2 221·· 3 (severe)
Gemma 4 E2B vis Q6–Q8 4 ····· 3 (severe)
Gemma 4 E2B vis FP16 10 332·· 3 (severe)
Gemma 4 E4B vis Q2–Q3 4 ····· 3 (severe)
Gemma 4 E4B vis Q4–Q5 5 332·· 3 (severe)
Gemma 4 E4B vis Q6–Q8 6.5 ····· 3 (severe)
Gemma 4 E4B vis FP16 16 443·· 2 (severe)
GLM-4.7-Flash Q2–Q3 15 ····· 2 (moderate)
GLM-4.7-Flash Q4–Q5 18 766·· 2 (moderate)
GLM-4.7-Flash Q6–Q8 25 ····· 2 (moderate)
GLM-4.7-Flash FP16 60 8774· 2 (moderate)
GLM-4.7 Q2–Q3 171 ·66·· 2 (severe)
GLM-4.7 Q4–Q5 205 888·· 1 (severe)
GLM-4.7 Q6–Q8 294 9998· 1 (severe)
GLM-4.7 FP16 717 9998· 1 (severe)
gpt-oss-120b Q4–Q5 63.4 9783· 2 (severe)
gpt-oss-20b Q4–Q5 12 7772· 2 (severe)
Granite 4.2 30B Q2–Q3 14 ····· 1 (mild)
Granite 4.2 30B Q4–Q5 18 ·56·· 1 (mild)
Granite 4.2 30B Q6–Q8 24 ·67·· 2 (moderate)
Granite 4.2 30B FP16 59 ·676· 2 (moderate)
Granite 4.2 8B Q2–Q3 4.5 ····· 3 (moderate)
Granite 4.2 8B Q4–Q5 5.5 ·45·· 3 (moderate)
Granite 4.2 8B Q6–Q8 7.5 ·56·· 3 (moderate)
Granite 4.2 8B FP16 18 ·564· 2 (moderate)
KAT-Coder-V2.5-Dev Q2–Q3 16.2 ·6··· 2 (moderate)
KAT-Coder-V2.5-Dev Q4–Q5 21.4 ·75·· 2 (moderate)
KAT-Coder-V2.5-Dev Q6–Q8 30.1 ·8··· 2 (moderate)
KAT-Coder-V2.5-Dev FP16 69.4 ·86·· 2 (moderate)
Llama 3.1 8B Q2–Q3 4 ····· 1 (moderate)
Llama 3.1 8B Q4–Q5 5 467·7 1 (moderate)
Llama 3.1 8B Q6–Q8 7 ····· 1 (moderate)
Llama 3.1 8B FP16 16 567·7 1 (moderate)
Llama 3.2 3B Q2–Q3 1.9 ····· 1 (moderate)
Llama 3.2 3B Q4–Q5 2.1 4·5·6 1 (moderate)
Llama 3.2 3B Q6–Q8 2.7 ····· 1 (moderate)
Llama 3.2 3B FP16 6.5 5·6·6 1 (moderate)
Llama 3.3 70B Q2–Q3 34.3 5···7 3 (severe)
Llama 3.3 70B Q4–Q5 42.5 6·6·8 3 (severe)
Llama 3.3 70B Q6–Q8 57.9 7···9 3 (severe)
Llama 3.3 70B FP16 141.1 767·9 3 (severe)
Mistral Small 4 vis Q2–Q3 54.4 ·5··· 2 (severe)
Mistral Small 4 vis Q4–Q5 73.8 76··· 2 (severe)
Mistral Small 4 vis Q6–Q8 99.4 87·7· 2 (severe)
Mistral Small 4 vis FP16 238 87·7· 2 (severe)
Muse Glimmer 30B vis Q2–Q3 13 ····· 2 (severe)
Muse Glimmer 30B vis Q4–Q5 17 777·7 2 (severe)
Muse Glimmer 30B vis Q6–Q8 26 ····· 2 (severe)
Muse Glimmer 30B vis FP16 59 87837 2 (severe)
Nanbeige4.2 3B Q2–Q3 2.24 34··· 2 (severe)
Nanbeige4.2 3B Q4–Q5 2.68 66··· 2 (severe)
Nanbeige4.2 3B Q6–Q8 3.6 77··· 2 (severe)
Nanbeige4.2 3B FP16 8.34 87··· 2 (severe)
Nemotron 3 Nano 30B-A3B Q2–Q3 19 ····· 3 (severe)
Nemotron 3 Nano 30B-A3B Q4–Q5 24.7 75··· 2 (moderate)
Nemotron 3 Nano 30B-A3B Q6–Q8 33.4 8···· 2 (moderate)
Nemotron 3 Nano 30B-A3B FP16 63.2 865·7 2 (moderate)
Nemotron 3 Super 120B-A12B Q2–Q3 64.7 ·54·· 2 (moderate)
Nemotron 3 Super 120B-A12B Q4–Q5 87 876·· 1 (mild)
Nemotron 3 Super 120B-A12B Q6–Q8 113.6 98777 1 (mild)
Nemotron 3 Super 120B-A12B FP16 240 98777 1 (mild)
Ornith-1.5 35B-A3B vis Q2–Q3 16.7 ·65·· 2 (moderate)
Ornith-1.5 35B-A3B vis Q4–Q5 21.9 ·76·· 2 (moderate)
Ornith-1.5 35B-A3B vis Q6–Q8 30.5 ·87·· 2 (moderate)
Ornith-1.5 35B-A3B vis FP16 71.1 ·87·· 2 (moderate)
Ornith-1.5 9B Q4–Q5 5.8 ·65·· 2 (moderate)
Ornith-1.5 9B Q6–Q8 7.6 ·76·· 1 (moderate)
Ornith-1.5 9B FP16 18.4 ·76·· 1 (moderate)
Phi-4-mini Q2–Q3 2.1 ····· 1 (severe)
Phi-4-mini Q4–Q5 2.5 555·· 1 (severe)
Phi-4-mini Q6–Q8 3.2 ····· 1 (severe)
Phi-4-mini FP16 7.7 66625 1 (severe)
Phi-4-reasoning-vision vis Q2–Q3 7 ····· 2 (severe)
Phi-4-reasoning-vision vis Q4–Q5 9 ····· 2 (severe)
Phi-4-reasoning-vision vis Q6–Q8 12 ····· 2 (severe)
Phi-4-reasoning-vision vis FP16 29 ····· 2 (severe)
Phi-4 Q2–Q3 7 ····· 3 (severe)
Phi-4 Q4–Q5 9 66··· 3 (severe)
Phi-4 Q6–Q8 12 ····· 3 (severe)
Phi-4 FP16 29 77·5· 3 (severe)
Qwen3 14B Q2–Q3 7 ····· 2 (moderate)
Qwen3 14B Q4–Q5 9 766·7 2 (moderate)
Qwen3 14B Q6–Q8 12 ····· 2 (moderate)
Qwen3 14B FP16 30 87757 2 (moderate)
Qwen3 30B-A3B Q2–Q3 11 454·· 3 (severe)
Qwen3 30B-A3B Q4–Q5 17 776·7 2 (moderate)
Qwen3 30B-A3B Q6–Q8 24 877·7 2 (moderate)
Qwen3 30B-A3B FP16 61 877·7 2 (moderate)
Qwen3 32B Q2–Q3 16 ····· 2 (mild)
Qwen3 32B Q4–Q5 20 776·7 2 (mild)
Qwen3 32B Q6–Q8 27 ····· 2 (mild)
Qwen3 32B FP16 66 87757 2 (mild)
Qwen3 4B Q2–Q3 2.1 ····· 2 (moderate)
Qwen3 4B Q4–Q5 2.5 655·7 2 (moderate)
Qwen3 4B Q6–Q8 3.3 ····· 2 (moderate)
Qwen3 4B FP16 8 76657 2 (moderate)
Qwen3 8B Q2–Q3 4 344·6 4 (severe)
Qwen3 8B Q4–Q5 5 666·7 2 (moderate)
Qwen3 8B Q6–Q8 7 ····· 2 (moderate)
Qwen3 8B FP16 16 76667 2 (moderate)
Qwen3-Coder-Next 80B-A3B Q2–Q3 38.3 ·54·· 2 (moderate)
Qwen3-Coder-Next 80B-A3B Q4–Q5 49.3 ·76·· 1 (moderate)
Qwen3-Coder-Next 80B-A3B Q6–Q8 65.6 ·87·· 1 (moderate)
Qwen3-Coder-Next 80B-A3B FP16 159 ·87·· 1 (moderate)
Qwen3.5 122B-A10B vis Q2–Q3 56.4 ·54·· 2 (moderate)
Qwen3.5 122B-A10B vis Q4–Q5 76.5 ·77·· 1 (moderate)
Qwen3.5 122B-A10B vis Q6–Q8 101 88889 1 (moderate)
Qwen3.5 122B-A10B vis FP16 244 88889 1 (moderate)
Qwen3.5 397B-A17B vis Q2–Q3 177 ·65·· 2 (moderate)
Qwen3.5 397B-A17B vis Q4–Q5 244 887·· 2 (moderate)
Qwen3.5 397B-A17B vis Q6–Q8 327 99889 2 (moderate)
Qwen3.5 397B-A17B vis FP16 793 99889 2 (moderate)
Qwen3.5 9B vis Q2–Q3 4.5 ····· —
Qwen3.5 9B vis Q4–Q5 5.5 ····· —
Qwen3.5 9B vis Q6–Q8 7.5 ····· —
Qwen3.5 9B vis FP16 18 8···· —
Qwen3.6 27B vis Q2–Q3 14 775·· 2 (moderate)
Qwen3.6 27B vis Q4–Q5 17 886·· 1 (moderate)
Qwen3.6 27B vis Q6–Q8 23 886·· 1 (moderate)
Qwen3.6 27B vis FP16 55 886·· 1 (moderate)
Qwen3.6 35B-A3B vis Q2–Q3 17 664·· 2 (moderate)
Qwen3.6 35B-A3B vis Q4–Q5 22 775·· 2 (moderate)
Qwen3.6 35B-A3B vis Q6–Q8 31 886·· 2 (moderate)
Qwen3.6 35B-A3B vis FP16 70 886·· 2 (moderate)
Qwen3.8 27B vis Q2–Q3 10.7 776·7 3 (severe)
Qwen3.8 27B vis Q4–Q5 17 898·8 3 (severe)
Qwen3.8 27B vis Q6–Q8 29 898·8 3 (severe)
Qwen3.8 27B vis FP16 55 898·8 2 (moderate)

NOT SHOWN: Long ctx · Writing — under 15% of rows carry a rating, so the columns would be mostly empty. The scores that do exist are on each model's sheet.

Every number is an editorial judgment over cited evidence — open a model sheet for provenance. Unsure which to pick? The guided picker weighs these for your task.