Known-issues sheets for local language models Rev 0.1.0 · reviewed every 7 days
llm-picker

Full characteristics table

Explore all ratings

One row per model × quant band. Blank cells mean not yet rated — never a guessed score. Click a column header to sort.

Quant band
Model Quant band Needs GB Math Code Tools Instr. Writing Issues
DeepSeek R1-0528 Qwen3-8B Q2–Q3 4 ····· 2 (severe)
DeepSeek R1-0528 Qwen3-8B Q4–Q5 5 ····· 2 (severe)
DeepSeek R1-0528 Qwen3-8B Q6–Q8 7 ····· 2 (severe)
DeepSeek R1-0528 Qwen3-8B FP16 16 86··· 2 (severe)
DeepSeek-V4-Flash-0731 Q2–Q3 128 ·65·· 4 (moderate)
DeepSeek-V4-Flash-0731 Q4–Q5 156 ·87·· 3 (moderate)
DeepSeek-V4-Flash-0731 Q6–Q8 162 ·87·· 3 (moderate)
Gemma 3 12B vis sup Q2–Q3 6 3···4 2 (severe)
Gemma 3 12B vis sup Q4–Q5 7 45·75 1 (moderate)
Gemma 3 12B vis sup Q6–Q8 10 ····· 1 (moderate)
Gemma 3 12B vis sup FP16 24 55··5 1 (moderate)
Gemma 3 27B vis sup Q2–Q3 13 ····· 3 (severe)
Gemma 3 27B vis sup Q4–Q5 17 44··6 3 (severe)
Gemma 3 27B vis sup Q6–Q8 22 ····· 3 (severe)
Gemma 3 27B vis sup FP16 54 54··6 3 (severe)
Gemma 3 4B vis sup Q2–Q3 2.1 ····· 2 (severe)
Gemma 3 4B vis sup Q4–Q5 2.5 34··4 2 (severe)
Gemma 3 4B vis sup Q6–Q8 3.2 ····· 2 (severe)
Gemma 3 4B vis sup FP16 7.8 34··4 2 (severe)
Gemma 4 12B vis Q2–Q3 6 ····· 3 (severe)
Gemma 4 12B vis Q4–Q5 7 666·· 3 (severe)
Gemma 4 12B vis Q6–Q8 10 ····· 3 (severe)
Gemma 4 12B vis FP16 24 77776 1 (moderate)
Gemma 4 26B-A4B vis Q2–Q3 13 ····· 3 (moderate)
Gemma 4 26B-A4B vis Q4–Q5 14 776·· 3 (moderate)
Gemma 4 26B-A4B vis Q6–Q8 23 ····· 3 (moderate)
Gemma 4 26B-A4B vis FP16 50 887·6 3 (moderate)
Gemma 4 31B vis Q2–Q3 15 ····· 5 (severe)
Gemma 4 31B vis Q4–Q5 18 776·· 5 (severe)
Gemma 4 31B vis Q6–Q8 25 ····· 5 (severe)
Gemma 4 31B vis FP16 61 887·6 4 (moderate)
Gemma 4 E2B vis Q2–Q3 2.5 ····· 3 (severe)
Gemma 4 E2B vis Q4–Q5 3.2 221·· 3 (severe)
Gemma 4 E2B vis Q6–Q8 4 ····· 3 (severe)
Gemma 4 E2B vis FP16 10 332·· 3 (severe)
Gemma 4 E4B vis Q2–Q3 4 ····· 3 (severe)
Gemma 4 E4B vis Q4–Q5 5 332·· 3 (severe)
Gemma 4 E4B vis Q6–Q8 6.5 ····· 3 (severe)
Gemma 4 E4B vis FP16 16 4434· 2 (severe)
GLM-4.7-Flash Q2–Q3 15 ····· 2 (moderate)
GLM-4.7-Flash Q4–Q5 18 766·5 2 (moderate)
GLM-4.7-Flash Q6–Q8 25 ····· 2 (moderate)
GLM-4.7-Flash FP16 60 877·5 2 (moderate)
GLM-4.7 sup Q2–Q3 171 ·66·· 2 (severe)
GLM-4.7 sup Q4–Q5 205 888·· 1 (severe)
GLM-4.7 sup Q6–Q8 294 999·· 1 (severe)
GLM-4.7 sup FP16 717 999·· 1 (severe)
GLM-5.3-Flash vis Q2–Q3 120 6654· 4 (moderate)
GLM-5.3-Flash vis Q4–Q5 200 7875· 4 (moderate)
GLM-5.3-Flash vis Q6–Q8 292 8985· 4 (moderate)
GLM-5.3-Flash vis FP16 642 8985· 4 (moderate)
gpt-oss-120b Q4–Q5 63.4 978·3 2 (severe)
gpt-oss-20b Q4–Q5 12 777·2 2 (severe)
Granite 4.2 30B Q2–Q3 14 ····· 1 (mild)
Granite 4.2 30B Q4–Q5 18 ·55·· 1 (mild)
Granite 4.2 30B Q6–Q8 24 ·66·· 1 (mild)
Granite 4.2 30B FP16 59 8667· 1 (mild)
Granite 4.2 8B Q2–Q3 4.5 ····· 2 (moderate)
Granite 4.2 8B Q4–Q5 5.5 ·44·· 2 (moderate)
Granite 4.2 8B Q6–Q8 7.5 ·55·· 2 (moderate)
Granite 4.2 8B FP16 18 8557· 2 (moderate)
K2-Horizon 7B Q2–Q3 4.6 433·· 5 (severe)
K2-Horizon 7B Q4–Q5 5.6 6555· 5 (severe)
K2-Horizon 7B Q6–Q8 7.4 8765· 4 (severe)
K2-Horizon 7B FP16 18 8765· 4 (severe)
K2-Horizon MoVA 36B-A4B Q2–Q3 17.7 54··· 6 (severe)
K2-Horizon MoVA 36B-A4B Q4–Q5 22.4 66··· 5 (severe)
K2-Horizon MoVA 36B-A4B Q6–Q8 30.8 76··· 5 (severe)
K2-Horizon MoVA 36B-A4B FP16 74.9 76··· 5 (severe)
KAT-Coder-V2.5-Dev Q2–Q3 16.2 ·6··· 2 (moderate)
KAT-Coder-V2.5-Dev Q4–Q5 21.4 ·75·· 2 (moderate)
KAT-Coder-V2.5-Dev Q6–Q8 30.1 ·8··· 2 (moderate)
KAT-Coder-V2.5-Dev FP16 69.4 ·86·· 2 (moderate)
Ling 3.0 Flash Q2–Q3 59 6547· 4 (moderate)
Ling 3.0 Flash Q4–Q5 77 8778· 3 (moderate)
Ling 3.0 Flash Q6–Q8 104.8 9888· 3 (moderate)
Ling 3.0 Flash FP16 255.1 9888· 3 (moderate)
Ling 3.0 Tiny Q2–Q3 3.8 433·· 4 (severe)
Ling 3.0 Tiny Q4–Q5 4.9 6456· 3 (moderate)
Ling 3.0 Tiny Q6–Q8 6.8 7566· 3 (moderate)
Ling 3.0 Tiny FP16 15.8 7566· 2 (mild)
Llama 3.1 8B Q2–Q3 4 ····· 1 (moderate)
Llama 3.1 8B Q4–Q5 5 46772 1 (moderate)
Llama 3.1 8B Q6–Q8 7 ····· 1 (moderate)
Llama 3.1 8B FP16 16 56772 1 (moderate)
Llama 3.2 3B Q2–Q3 1.9 ····· 1 (moderate)
Llama 3.2 3B Q4–Q5 2.1 4·562 1 (moderate)
Llama 3.2 3B Q6–Q8 2.7 ····· 1 (moderate)
Llama 3.2 3B FP16 6.5 5·662 1 (moderate)
Llama 3.3 70B Q2–Q3 34.3 5··7· 3 (severe)
Llama 3.3 70B Q4–Q5 42.5 6·68· 3 (severe)
Llama 3.3 70B Q6–Q8 57.9 7··9· 3 (severe)
Llama 3.3 70B FP16 141.1 7679· 3 (severe)
MiMo-V2.6-Flash (MOPD) vis Q2–Q3 126 ·66·· 4 (moderate)
MiMo-V2.6-Flash (MOPD) vis Q4–Q5 175 ·88·· 3 (moderate)
MiniCPM5 2B Q2–Q3 1.3 433·· 5 (severe)
MiniCPM5 2B Q4–Q5 1.6 7556· 4 (moderate)
MiniCPM5 2B Q6–Q8 2.7 8666· 4 (moderate)
MiniCPM5 2B FP16 5 8666· 4 (moderate)
Mistral Small 4 vis Q2–Q3 54.4 ·5··· 2 (severe)
Mistral Small 4 vis Q4–Q5 73.8 76··5 2 (severe)
Mistral Small 4 vis Q6–Q8 99.4 87··· 2 (severe)
Mistral Small 4 vis FP16 238 87··5 2 (severe)
Muse Glimmer 30B vis Q2–Q3 13 ····· 1 (severe)
Muse Glimmer 30B vis Q4–Q5 17 77778 2 (severe)
Muse Glimmer 30B vis Q6–Q8 26 ····· 1 (severe)
Muse Glimmer 30B vis FP16 59 87878 1 (severe)
Nanbeige4.2 3B Q2–Q3 2.24 34··· 2 (severe)
Nanbeige4.2 3B Q4–Q5 2.68 66··· 2 (severe)
Nanbeige4.2 3B Q6–Q8 3.6 77··· 2 (severe)
Nanbeige4.2 3B FP16 8.34 87··· 2 (severe)
Nemotron 3 Nano 30B-A3B sup Q2–Q3 19 ····· 3 (severe)
Nemotron 3 Nano 30B-A3B sup Q4–Q5 24.7 75··· 2 (moderate)
Nemotron 3 Nano 30B-A3B sup Q6–Q8 33.4 8···· 2 (moderate)
Nemotron 3 Nano 30B-A3B sup FP16 63.2 8657· 2 (moderate)
Nemotron 3 Super 120B-A12B Q2–Q3 64.7 ·54·· 2 (moderate)
Nemotron 3 Super 120B-A12B Q4–Q5 87 876·· 1 (mild)
Nemotron 3 Super 120B-A12B Q6–Q8 113.6 9877· 1 (mild)
Nemotron 3 Super 120B-A12B FP16 240 9877· 1 (mild)
Nemotron 3.5 Lightning 30B-A3B Q2–Q3 19.8 43··· 4 (moderate)
Nemotron 3.5 Lightning 30B-A3B Q4–Q5 25.5 654·5 3 (moderate)
Nemotron 3.5 Lightning 30B-A3B Q6–Q8 34.3 765·· 3 (moderate)
Nemotron 3.5 Lightning 30B-A3B FP16 65.9 7657· 2 (moderate)
Ornith-1.5 35B-A3B vis Q2–Q3 16.7 ·65·· 2 (moderate)
Ornith-1.5 35B-A3B vis Q4–Q5 21.9 ·76·· 2 (moderate)
Ornith-1.5 35B-A3B vis Q6–Q8 30.5 ·87·· 2 (moderate)
Ornith-1.5 35B-A3B vis FP16 71.1 ·87·· 2 (moderate)
Ornith-1.5 9B Q4–Q5 5.8 ·65·· 2 (moderate)
Ornith-1.5 9B Q6–Q8 7.6 ·76·· 1 (moderate)
Ornith-1.5 9B FP16 18.4 ·76·· 1 (moderate)
Phi-4-mini Q2–Q3 2.1 ····· 1 (severe)
Phi-4-mini Q4–Q5 2.5 555·· 1 (severe)
Phi-4-mini Q6–Q8 3.2 ····· 1 (severe)
Phi-4-mini FP16 7.7 6665· 1 (severe)
Phi-4-reasoning-vision vis Q2–Q3 7 ····· 2 (moderate)
Phi-4-reasoning-vision vis Q4–Q5 9 ····· 2 (moderate)
Phi-4-reasoning-vision vis Q6–Q8 12 ····· 2 (moderate)
Phi-4-reasoning-vision vis FP16 29 ····· 2 (moderate)
Phi-4 Q2–Q3 7 ····· 3 (severe)
Phi-4 Q4–Q5 9 66··· 3 (severe)
Phi-4 Q6–Q8 12 ····· 3 (severe)
Phi-4 FP16 29 77··· 3 (severe)
Qwen3 14B Q2–Q3 7 ····· 2 (moderate)
Qwen3 14B Q4–Q5 9 76674 2 (moderate)
Qwen3 14B Q6–Q8 12 ····· 2 (moderate)
Qwen3 14B FP16 30 87774 2 (moderate)
Qwen3 30B-A3B sup Q2–Q3 11 454·· 3 (severe)
Qwen3 30B-A3B sup Q4–Q5 17 7767· 2 (moderate)
Qwen3 30B-A3B sup Q6–Q8 24 8777· 2 (moderate)
Qwen3 30B-A3B sup FP16 61 8777· 2 (moderate)
Qwen3 32B sup Q2–Q3 16 ····· 2 (mild)
Qwen3 32B sup Q4–Q5 20 77675 2 (mild)
Qwen3 32B sup Q6–Q8 27 ····· 2 (mild)
Qwen3 32B sup FP16 66 87775 2 (mild)
Qwen3 4B sup Q2–Q3 2.1 ····· 2 (moderate)
Qwen3 4B sup Q4–Q5 2.5 65572 2 (moderate)
Qwen3 4B sup Q6–Q8 3.3 ····· 2 (moderate)
Qwen3 4B sup FP16 8 76672 2 (moderate)
Qwen3 8B sup Q2–Q3 4 3446· 4 (severe)
Qwen3 8B sup Q4–Q5 5 6667· 2 (moderate)
Qwen3 8B sup Q6–Q8 7 ····· 2 (moderate)
Qwen3 8B sup FP16 16 7667· 2 (moderate)
Qwen3-Coder-Next 80B-A3B Q2–Q3 38.3 ·54·· 2 (moderate)
Qwen3-Coder-Next 80B-A3B Q4–Q5 49.3 ·76·· 1 (moderate)
Qwen3-Coder-Next 80B-A3B Q6–Q8 65.6 ·87·· 1 (moderate)
Qwen3-Coder-Next 80B-A3B FP16 159 ·87·· 1 (moderate)
Qwen3.5 122B-A10B vis Q2–Q3 56.4 ·54·· 2 (moderate)
Qwen3.5 122B-A10B vis Q4–Q5 76.5 ·77·· 1 (moderate)
Qwen3.5 122B-A10B vis Q6–Q8 101 8889· 1 (moderate)
Qwen3.5 122B-A10B vis FP16 244 8889· 1 (moderate)
Qwen3.5 397B-A17B vis Q2–Q3 177 ·65·· 2 (moderate)
Qwen3.5 397B-A17B vis Q4–Q5 244 887·7 2 (moderate)
Qwen3.5 397B-A17B vis Q6–Q8 327 99897 2 (moderate)
Qwen3.5 397B-A17B vis FP16 793 99897 2 (moderate)
Qwen3.5 4B vis Q2–Q3 2.3 533·· 3 (moderate)
Qwen3.5 4B vis Q4–Q5 2.7 6446· 2 (mild)
Qwen3.5 4B vis Q6–Q8 3.5 7556· 2 (mild)
Qwen3.5 4B vis FP16 8.4 7556· 2 (mild)
Qwen3.5 9B vis Q2–Q3 4.5 ····· —
Qwen3.5 9B vis Q4–Q5 5.5 ····· —
Qwen3.5 9B vis Q6–Q8 7.5 ····· —
Qwen3.5 9B vis FP16 18 8677· —
Qwen3.6 27B vis sup Q2–Q3 14 7754· 2 (moderate)
Qwen3.6 27B vis sup Q4–Q5 17 8865· 1 (moderate)
Qwen3.6 27B vis sup Q6–Q8 23 8865· 1 (moderate)
Qwen3.6 27B vis sup FP16 55 8865· 1 (moderate)
Qwen3.6 35B-A3B vis Q2–Q3 17 664·· 2 (moderate)
Qwen3.6 35B-A3B vis Q4–Q5 22 775·· 2 (moderate)
Qwen3.6 35B-A3B vis Q6–Q8 31 886·· 2 (moderate)
Qwen3.6 35B-A3B vis FP16 70 886·· 2 (moderate)
Qwen3.8 27B vis Q2–Q3 10.7 7768· 5 (severe)
Qwen3.8 27B vis Q4–Q5 17 8988· 5 (severe)
Qwen3.8 27B vis Q6–Q8 29 8988· 5 (severe)
Qwen3.8 27B vis FP16 55 89886 2 (moderate)
Qwen3.8 Flash-Next vis Q2–Q3 90 565·· 5 (severe)
Qwen3.8 Flash-Next vis Q4–Q5 111 7878· 4 (severe)
Qwen3.8 Flash-Next vis Q6–Q8 169 8988· 4 (severe)
Qwen3.8 Flash-Next vis FP16 354 8988· 4 (severe)
Spark-X2.5 1.7B Q2–Q3 0.94 422·· 4 (severe)
Spark-X2.5 1.7B Q4–Q5 1.1 5336· 4 (moderate)
Spark-X2.5 1.7B Q6–Q8 1.8 6446· 3 (moderate)
Spark-X2.5 1.7B FP16 3.4 6446· 3 (moderate)
Spark-X2.5 4B Q2–Q3 2.2 544·· 5 (severe)
Spark-X2.5 4B Q4–Q5 2.6 7556· 5 (moderate)
Spark-X2.5 4B Q6–Q8 4.4 8667· 4 (moderate)
Spark-X2.5 4B FP16 8.2 8667· 4 (moderate)
Xing4.0 29B-A4B Q2–Q3 13.1 6545· 6 (severe)
Xing4.0 29B-A4B Q4–Q5 20.1 7656· 5 (severe)
Xing4.0 29B-A4B Q6–Q8 25.7 8767· 5 (severe)
Xing4.0 29B-A4B FP16 62.4 8767· 5 (severe)

NOT SHOWN: Long ctx · Facts — under 15% of rows carry a rating, so the columns would be mostly empty. The scores that do exist are on each model's sheet.

Every number is an editorial judgment over cited evidence — open a model sheet for provenance. Unsure which to pick? The guided picker weighs these for your task.