← all models

MODEL RESULTS — GEMMA-4-26B-A4B-IQ2_XXS

C:\Users\admin\models_bench\gemma-4-26B-A4B-it-UD-IQ2_XXS.gguf · server http://erwing · run 2026-10-13 01:45:39 → 2026-10-13 02:01:48

OVERALL

Composite: 9.1 ✓ 8/8 tests
Speed (median): 15.4 tok/s
Thinking cost: 0 tokens · ≈0s · starved: none

ENVIRONMENT & LOAD (verified)

Run metadata (recorded by runner)
serverhttp://erwing
date2026-10-13 01:38:56
hardwareerwing · GTX 1080 8 GB · 16 GB RAM
context16K (16384) — 9.24 GiB model exceeds VRAM; MoE experts offloaded to system RAM via --cpu-moe (15.9 tok/s vs 4.3 auto-fit)
tuningllama.cpp 2.55.0 CUDA · n-gpu-layers 99 · --cpu-moe · flash-attn · KV q8_0 · no vision · PAR 1

PER-TEST BREAKDOWN

TestScoreCheck / detailContent tokThink tok≈Think sElapsed stok/sOutput
speed—26600.018.2114.61speed.txt ↗
fib10 ·objectivefib(0..10) correct, fib(50)=12586269025127300.082.5615.42fib.txt ↗
reasoning10 ·review15900.011.1214.3reasoning.txt ↗
constraints10 ·objective3 sentence(s) found (target 3)129300.080.9915.97constraints.txt ↗
json10 ·objectivevalid JSON, all keys + types correct34400.021.8515.74json.txt ↗
creative6 ·review256300.0164.2715.6creative.txt ↗
breakout9 ·reviewcanvas=yes script=yes self_contained=yes lines=430484100.0311.1815.56breakout.html ↗
delta9 ·reviewcanvas=yes script=yes self_contained=yes lines=386450900.0314.7914.32delta.html ↗
fractal8 ·reviewcanvas=yes script=yes self_contained=yes lines=302500200.0341.2714.66fractal.html ↗

GENERATED GAMES

breakout
breakout · canvas painted · score 9 · 0 render errs
play-test: paints, animates, responds to input
Open breakout.html ↗screenshot
delta
delta · canvas painted · score 9 · 0 render errs
play-test: paints, animates, responds to input
Open delta.html ↗screenshot
fractal
fractal · canvas painted · score 8 · 0 render errs
play-test: paints, static, responds to input
Open fractal.html ↗screenshot

RAW TEXT / CODE OUTPUTS

speed.txt (140 bytes, full file beside this page)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
fib.txt (87 bytes, full file beside this page)
def fib(n):
    a, b = 0, 1
    for _ in range(n):
        a, b = b, a + b
    return a
reasoning.txt (112 bytes, full file beside this page)
**Reasoning:** The phrase "all but 9 die" means that 9 sheep survived, while the rest died.

**Final number:** 9
constraints.txt (185 bytes, full file beside this page)
Dark clouds rolled across the sky, obscuring the afternoon sun. A steady rhythm of raindrops began to tap against the rooftops. The world turned a soft, muted gray beneath the downpour.
json.txt (85 bytes, full file beside this page)
{"name": "Alice Smith", "age": 28, "hobbies": ["photography", "swimming", "cooking"]}
creative.txt (562 bytes, full file beside this page)
The view from the observation deck was breathtaking. The blue marble of Earth hung suspended in the velvet void, a jewel of life. Kael sipped his recycled coffee, feeling the hum of the life-support systems beneath his boots. It was a lonely life, but it was his. He tapped the glass, a silent salute to the home he’d left behind. 

Suddenly, a massive shadow eclipsed the sun. A gargantuan hand descended from the heavens, obscuring the stars. A booming, cosmic voice vibrated through the hull: "Put the lid back on, Timmy. You're getting the goldfish all wet."
Genuine model outputs — files saved verbatim under gemma-4-26b-a4b-iq2_xxs/ (source of truth in tests/<name>/result.json). Game links open the raw HTML the model produced.