← all models

MODEL RESULTS — GEMMA-4-12B

google/gemma-4-12b-qat · server http://strata · run 2026-10-05 01:06:29 → 2026-10-05 01:06:46

OVERALL

Composite: 8.6 ✓ 8/8 tests
Speed (median): 73.4 tok/s
Thinking cost: 8,170 tokens · ≈110s · starved: none

ENVIRONMENT & LOAD (verified)

Gemma-4-12B-QAT on a 12 GB 3080 Ti — composite 8.6 (8/8), 73.4 tok/s: the fastest 12B-class model on the board. Run 2026-10-05 on box strata (LM Studio ) before its retirement; the exact context window was not recorded in the manifest, only bracketed by lms --estimate-only numbers taken the same week.
Serverhttp://strata (manifest) — LM Studio on the 3080 Ti
Modelgoogle/gemma-4-12b-qat
Context bracket (same-week estimates)8K ≈ 8.1 GiB · 16K ≈ 9.4 GiB · 32K ≈ 11.8 GiB (fits) · 64K ≈ 16.8 GiB (will not load) → the run was ≤32K
Evidence it completed normallybreakout 4,677 tokens, hit_cap False, 63.7 s; creative 1,050 tokens, 13.9 s
Speed73.4 tok/s speed test — consistent with a 12B QAT fully on a 3080 Ti
Observations
· [assistant] Manifest timestamps (started/finished 17 s apart) are migration artifacts, not the real run window — per-test elapsed_s values are the reliable timings. (noted)
Still to verify
· Exact context window of the run never recorded.
· Box strata retired Oct 2026 — cannot re-verify; record frozen.

PER-TEST BREAKDOWN

TestScoreCheck / detailContent tokThink tok≈Think sElapsed stok/sOutput
speed—1451081.453.4174.23speed.txt ↗
fib10 ·objectivefib(0..10) correct, fib(50)=1258626902545211528.2628.8774.83fib.txt ↗
reasoning9 ·review421442.032.6271.06reasoning.txt ↗
constraints10 ·objective3 sentence(s) found (target 3)48117315.6116.2575.14constraints.txt ↗
json10 ·objectivevalid JSON, all keys + types correct322102.923.3672.03json.txt ↗
creative8 ·review12792312.2613.9575.26creative.txt ↗
breakout8 ·review370797013.2263.7373.39breakout.html ↗
delta7 ·review330681011.0656.2273.22delta.html ↗
fractal8 ·review2452171723.5857.2772.8fractal.html ↗

GENERATED GAMES

breakout
breakout · canvas painted · score 8 · 0 render errs
Open breakout.html ↗screenshot
delta
delta · canvas painted · score 7 · 0 render errs
Open delta.html ↗screenshot
fractal
fractal · canvas painted · score 8 · 0 render errs
Open fractal.html ↗screenshot

RAW TEXT / CODE OUTPUTS

speed.txt (140 bytes, full file beside this page)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
fib.txt (87 bytes, full file beside this page)
def fib(n):
    a, b = 0, 1
    for _ in range(n):
        a, b = b, a + b
    return a
reasoning.txt (133 bytes, full file beside this page)
Reasoning: The phrase "all but 9 die" means that every sheep died except for 9 of them. Therefore, 9 sheep survived.

Final number: 9
constraints.txt (211 bytes, full file beside this page)
Grey clouds blanketed the sky as a steady drizzle began to fall. Water pooled in the gutters and splashed against the pavement with a rhythmic beat. The world felt hushed and cool under the veil of falling mist.
json.txt (82 bytes, full file beside this page)
{"name": "Alice Johnson", "age": 28, "hobbies": ["Reading", "Hiking", "Painting"]}
creative.txt (569 bytes, full file beside this page)
Commander Vance paced the artificial grass of Habitat 4, watching the stars move in their scripted arcs. He spoke daily to "Ground Control," thanking them for the nutrient paste and the perfect synthetic sunlight. To the public, he was a hero, the first human to live permanently in the void. He felt like a pioneer, a solitary explorer of the infinite. 

Today, a massive shadow eclipsed the station. A face appeared on the other side of the reinforced glass—not human, but a colossal, wet eye. A booming vibration rattled his ribs. 

"Feed time," the voice commanded.
Genuine model outputs — files saved verbatim under gemma-4-12b/ (source of truth in tests/<name>/result.json). Game links open the raw HTML the model produced.