← all models

MODEL RESULTS — GEMMA-4-12B-IT-QAT

C:\Users\admin\models_bench\gemma-4-12b-it-qat-q4_0.gguf · server http://erwing · run 2026-10-13 01:17:25 → 2026-10-13 01:26:46

OVERALL

Composite: 9.1 ✓ 8/8 tests
Speed (median): 21.1 tok/s
Thinking cost: 0 tokens · ≈0s · starved: none

ENVIRONMENT & LOAD (verified)

Run metadata (recorded by runner)
serverhttp://erwing
date2026-10-13 01:12:31
hardwareerwing · GTX 1080 8 GB · 16 GB RAM
context24K (24576) — resident (16K 23.6 vs 24K 22.3 tok/s, no spill cliff)
tuningllama.cpp 2.55.0 CUDA · n-gpu-layers 99 · flash-attn · KV q8_0 · no vision · PAR 1

PER-TEST BREAKDOWN

TestScoreCheck / detailContent tokThink tok≈Think sElapsed stok/sOutput
speed—25300.010.823.42speed.txt ↗
fib10 ·objectivefib(0..10) correct, fib(50)=12586269025183300.082.1422.31fib.txt ↗
reasoning10 ·review17800.08.4221.15reasoning.txt ↗
constraints10 ·objective3 sentence(s) found (target 3)92100.042.1221.87constraints.txt ↗
json10 ·objectivevalid JSON, all keys + types correct24300.011.4721.19json.txt ↗
creative8 ·review264700.0125.6921.06creative.txt ↗
breakout9 ·reviewcanvas=yes script=yes self_contained=yes lines=394432800.0207.5720.85breakout.html ↗
delta9 ·reviewcanvas=yes script=yes self_contained=yes lines=313395100.0190.1820.78delta.html ↗
fractal7 ·reviewcanvas=yes script=yes self_contained=yes lines=227336800.0161.4420.86fractal.html ↗

GENERATED GAMES

breakout
breakout · canvas painted · score 9 · 0 render errs
play-test: paints, animates, responds to input
Open breakout.html ↗screenshot
delta
delta · canvas painted · score 9 · 0 render errs
play-test: paints, animates, responds to input
Open delta.html ↗screenshot
fractal
fractal · canvas painted · score 7 · 0 render errs
play-test: paints, static, no input response
Open fractal.html ↗screenshot

RAW TEXT / CODE OUTPUTS

speed.txt (140 bytes, full file beside this page)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
fib.txt (87 bytes, full file beside this page)
def fib(n):
    a, b = 0, 1
    for _ in range(n):
        a, b = b, a + b
    return a
reasoning.txt (122 bytes, full file beside this page)
The phrase "all but 9 die" means that every sheep died except for 9 of them. Therefore, those 9 are the ones remaining.

9
constraints.txt (241 bytes, full file beside this page)
Gray clouds blanketed the sky as the first heavy drops began to fall. Rain tapped rhythmically against the windowpane, blurring the world outside into a watercolor painting. The air grew cool and heavy with the refreshing scent of wet earth.
json.txt (88 bytes, full file beside this page)
{"name": "Alice Johnson", "age": 28, "hobbies": ["Photography", "Gardening", "Cycling"]}
creative.txt (562 bytes, full file beside this page)
The silence of the *Aegis* was heavy, broken only by the rhythmic hum of the oxygen scrubbers. Commander Vance pressed his palm against the reinforced glass of the observation deck. Below, the Earth hung like a bruised jewel, its continents scarred by the Great Fire. He was the last human left, the final sentinel tasked with watching the world die in slow motion. 

A soft chime echoed in the corridor. Vance froze. 

"Who’s there?" he whispered into his headset. 

A voice crackled back, warm and familiar. "Dinner’s ready, Dad. Stop staring at the painting."
Genuine model outputs — files saved verbatim under gemma-4-12b-it-qat/ (source of truth in tests/<name>/result.json). Game links open the raw HTML the model produced.