Known-issues sheets for local language models Rev 0.1.0 · reviewed every 7 days

Model datasheet · Qwen3

Qwen3 8B

The default mid-size all-rounder. Strong reasoning and coding for its size, hybrid thinking mode, solid tool calling. The community's most common answer to 'which model should I start with?' on 16GB machines.

Vendor
Alibaba
Architecture
Dense · 8.2B
Context
32,768 tokens
License
Apache-2.0
Released
2025-04-29
Vision
No

→ GGUF (llama.cpp / LM Studio / Ollama) → MLX (Apple Silicon)

§1 Characteristics by quantization band

Q2–Q3 — 2–3 bit

4GB weights · e.g. IQ3_XXS , Q3_K_M + KV: 1.1GB at 8K · 4.5GB at 32K · 4.5GB at 128K
Math & reasoning 3/10
data checked Aug 2026
  • quant-degradation-community — KLD delta + degradation reports @ Q3_K_M · aggregated · 2026-08-30

    Editorial derivation: multi-step arithmetic degrades sharply at ≤3-bit; consistent community finding across Qwen-family models.

Coding 4/10
data checked Aug 2026
  • quant-degradation-community — KLD delta + degradation reports @ Q3_K_M · aggregated · 2026-08-30

    Editorial derivation: noticeably more syntax errors and logic slips at 3-bit.

Tool calling / agentic 4/10
data checked Aug 2026
  • quant-degradation-community — community consensus @ Q3_K_M · aggregated · 2026-08-30

    Editorial derivation: malformed JSON arguments become common at ≤3-bit.

Instruction following 6/10
data checked Aug 2026
  • quant-degradation-community — community consensus @ Q3_K_M · aggregated · 2026-08-30

    Editorial derivation: IF holds up better than math/coding at low quants.

Q4–Q5 — 4–5 bit

5GB weights · e.g. Q4_K_M , Q5_K_M , mlx-4bit + KV: 1.1GB at 8K · 4.5GB at 32K · 4.5GB at 128K
Math & reasoning 6/10
data checked Aug 2026
  • quant-degradation-community — KLD/perplexity delta vs bf16 @ Q4_K_M · aggregated · 2026-08-30

    Editorial derivation from the full-band score: community KLD data shows Q4_K_M retains most reasoning ability with a small consistent loss.

Coding 6/10
data checked Aug 2026
  • quant-degradation-community — KLD/perplexity delta vs bf16 @ Q4_K_M · aggregated · 2026-08-30

    Editorial derivation: Q4_K_M coding loss vs bf16 is minor per community testing.

Tool calling / agentic 6/10
data checked Aug 2026
  • quant-degradation-community — community consensus @ Q4_K_M · aggregated · 2026-08-30

    Editorial derivation: tool-call formatting stays reliable at 4-bit for this model per community reports.

Instruction following 7/10
data checked Aug 2026
  • quant-degradation-community — community consensus @ Q4_K_M · aggregated · 2026-08-30

    Editorial derivation: IF is not quant-sensitive; carried from full band.

Q6–Q8 — 6–8 bit

7GB weights · e.g. Q6_K , Q8_0 + KV: 1.1GB at 8K · 4.5GB at 32K · 4.5GB at 128K

— Not yet rated · contributions welcome —

FP16 — full precision (fp16/bf16)

16GB weights · e.g. bf16 + KV: 1.1GB at 8K · 4.5GB at 32K · 4.5GB at 128K
Math & reasoning 7/10
data checked Aug 2026
Coding 6/10
data checked Aug 2026
Tool calling / agentic 6/10
data checked Aug 2026
Instruction following 7/10
data checked Aug 2026
Factuality 6/10
data checked Aug 2026
Long context 6/10
data checked Aug 2026

§2 Per-quant deviations

IQ3_XXS · Math & reasoning drops to 2/10

IQ3_XXS is materially worse than Q3_K_M for arithmetic despite sharing the band — the extreme compression hits attention precision hardest.

§3 Known issues & what fixes them

ISSUE-01 severe Q2–Q3 · math

At 3-bit and below, multi-step arithmetic degrades sharply — expect dropped carries, wrong intermediate steps, and confidently wrong answers.

Fix
Code interpreter / calculator tool [strong]

Route calculations to a Python tool; the model plans fine, it just can't execute arithmetic reliably at this quant.

Fix
Move up a quant band [strong]

Q4_K_M needs only ~7GB and recovers most math ability.

Evidence · 2 sources · community-consensus
ISSUE-02 moderate Q2–Q3 · coding, tool-calling

At ≤3-bit, code gains subtle logic slips and tool calls start producing malformed JSON arguments.

Fix
Move up a quant band [strong]

The 4–5 bit band fixes most of this for ~1GB more memory.

Fix
Prompt technique [weak]

Constrain output with explicit format examples; helps somewhat with tool-call formatting.

Evidence · 2 sources · community-consensus
ISSUE-03 moderate Q2–Q3 / Q4–Q5 / Q6–Q8 / FP16 · creative-writing

Prose is competent but flat, with repetitive phrasing in longer outputs. This is the model's character, not a quant artifact.

No fix
No known fix — choose a different model

No tool meaningfully changes voice. If prose quality is the goal, Gemma 3 12B is the better pick at similar memory.

Evidence · 1 source · anecdotal
ISSUE-04 mild Q2–Q3 / Q4–Q5 / Q6–Q8 / FP16 · instruction-following

Qwen3 models fall into endless repetition loops under greedy decoding — the model card itself warns 'DO NOT use greedy decoding'. Quantized builds hit it more often.

Fix
Prompt technique [strong]

Use the card's sampler settings (temp 0.6 / top_p 0.95 / top_k 20 in thinking mode; 0.7 / 0.8 / 20 non-thinking) and presence_penalty up to 1.5 if loops persist.

Evidence · 2 sources · community-consensus