Record: Order-Adaptive 9-gram Backoff + Distributed Prefill — val_bpb 0.4405 (3-seed mean)#890

Open

sofiabod wants to merge 25 commits intoopenai:mainfrom

sofiabod:autoresearch/mar22

Commits on Mar 18, 2026

Commits on Mar 23, 2026

Commits on Mar 26, 2026

exp52: n-gram cache 4M buckets, single eval pass, fix zero-prob mixing
sofiabod
committed
exp54: 5-gram fixed alpha=0.2 cache (PR #769 recipe)
sofiabod
committed
exp55: truly sequential n-gram (fix chunking stale-count bug)
sofiabod
committed
exp56: dict-based n-gram cache (zero collisions), fixed alpha=0.05
sofiabod
committed
exp57: multi-order backoff 2-5 gram dict cache, alpha=0.2
sofiabod
committed
exp58: rewrite n-gram to match PR #753/#769/#779 (dual hash tables, per-window score-first, entropy-adaptive alpha, tc>0 check)
sofiabod
committed
exp59: 9-gram + per-order entropy thresholds + distributed prefill
sofiabod
committed
exp60: adopt PR #825 full stack (MHA 8/8, MLP 3.5x, XSA-all, BigramHash 6144, int5, stride=32) + 9-gram prefill
sofiabod
committed
exp61: submission-ready (BigramHash 4096, skip diag evals, int5 QAT)
sofiabod
committed
Record: Order-Adaptive 9-gram Backoff + Distributed Prefill (mean val_bpb=0.4405, 3 seeds)
sofiabod
committed