docs(research): WAN chain K-lever benchmark, R(K) round law, receipt protocol#33
Open
463464q435q43 wants to merge 1 commit into
Open
docs(research): WAN chain K-lever benchmark, R(K) round law, receipt protocol#33463464q435q43 wants to merge 1 commit into
463464q435q43 wants to merge 1 commit into
Conversation
…protocol A third lever the paper's section-4.2 dichotomy (raise alpha or cut T) overlooks: the chain round length K, at fixed alpha and fixed T. On a scattered-EU WAN M2.5 ring (274.8 ms loop, engine 182e93b pristine, byte-identical-to-greedy every run) sweeping K at depth 8 moves the verbatim cell 181.5 (K=8) -> 294.9 +/- 25.4 (K=48, peak-adjacent) on a 420-tok copy and 647.7 (K=64) -> 710.2 +/- 20.1 (K=128) on a ~1k-token sustained continuation. Both knees are LOCATED and bracketed from both sides (420-tok cell peaks at K=64; long cell at K=128, with K=192/256 reading below their interleaved K=128 control - the round-time growth outpaces the round savings above the knee, while byte identity and structural acceptance hold perfectly through K=256). Round counts follow a zero-parameter law R(K) = warmup + ceil(C/K), verified at every tested K from 8 through 256 including past the throughput knee: four pre-registered round-count predictions hit exactly (R=14@K96, R=11@K128, R=9@K192, R=7@K256), g = 1008/R exact each time. Round time follows COMMITTED tokens, not draft size - the commit-attribution model won two independent pre-registered model brackets against draft-slope alternatives. The document also proposes the benchmarking protocol used for all rows (pre-registration before data, byte-identity as a class boundary, regime binding, interleaved A/B for engine deltas) and includes class-fair comparator sentences that name both configs and both network classes - including the interactive cell where the comparison favors upstream.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
PR: WAN chain K-lever benchmark, zero-parameter round law, and a receipt protocol (docs-only)
Target:
leyten/shardmaster (based on182e93b, applies clean).Branch:
mosaic/wan-chain-k-benchmark· Files:docs/research/wan-chain-k-benchmark.md(new, docs only — no code).Motivation
Three things we measured on our own scattered-EU M2.5 ring (6× RTX 5090, 274.8 ms loop, this
repo's engine at
182e93b, pristine/config-only) that belong in upstream's research docs:draftable number. K — the chain round length, fixed at 8 in
research/m25_ctx_table.py— is athird lever, lossless by construction, and it is large: 181.5 → 294.9 ± 25.4 tok/s on a 420-tok
verbatim copy (K 8→48, d8), 647.7 → 710.2 ± 20.1 on a ~1k-token sustained continuation
(K 64→128), every run byte-identical to plain greedy. Both throughput knees are located and
bracketed from both sides (420-tok cell peaks at K=64; long cell at K=128 — K=192/256 read
below their interleaved K=128 control, with byte identity still perfect at K=256: the knee is
round-time growth, not acceptance or proposal-quality collapse).
R(K) = warmup + ceil(C/K)— reproduces all 8 ladder rungs on the 420-tok cell and hit FOURpre-registered predictions exactly on the long cell (R=14@K96, R=11@K128, R=9@K192, R=7@K256,
g = 1008/R exact each time). Verified at every tested K from 8 through 256, including past the
knee — the law prices rounds, not speed. Round time follows committed tokens (draft-size
slope ≈ 0): the "commit-attribution" model won two independent pre-registered model brackets
against alternatives.
regime binding, config-stated comparator sentences, interleaved A/B for engine deltas. Five of
our banked receipts are pre-registered negatives — the discipline is what makes the wins
trustworthy. The doc proposes this as a convention for
docs/receipts/.The doc cites the paper by its Zenodo concept DOI
10.5281/zenodo.21178430(the READMEbadge's DOI; the current version 1.2 resolves at
10.5281/zenodo.21180635— both land onthe same record, verified 2026-07-07).
The doc also contains our comparator sentences vs the paper's promoted numbers, written
class-fair (both configs, both loop RTTs, in one sentence) — including the interactive cell where
the comparison favors upstream (10.87 ± 0.79 on our 274.8 ms loop vs 10.7–12.6 promoted on
~105 ms). We'd rather these sentences live where the compared party can review them.
Why upstream might want this
located optimum and a predictive law that went 6-for-6 on pre-registered round-count
predictions across the full tested range.
configs) protects upstream's numbers as much as ours.
Verification
Receipt names are cited inline throughout the doc; raw per-run JSONs, prompts, signed receipts,
and the exact
m25_run_arm.pyconfigs are retained on our side and can be furnished on request.Every claimed row includes n, CI, g (exact), engine sha, and its regime.
License / transfer
Contributed under Apache-2.0 like the rest of the repo. Mosaic Intelligence retains authorship
credit for the measurements; upstream is free to edit, condense, or fold the protocol section
into its own conventions.
Prepared 2026-07-07 by the authors (Mosaic Intelligence).