A pre-registered self-measurement of this machine on its frozen register of 132 decided claims: what re-derives, what it costs, whether planted false claims are refuted and planted true ones certified, whether two implementations agree, and what a conventional double-precision check would have done on the same objects. Not a comparison: no public system audits external claims with exact certificates and published refusals, so the comparators are this repository's own second implementations and a float checker written for the audit. The definitions were fixed before anything ran and are pinned by sha256 in every record.
Published, not peer-reviewed. Every decider and every witness script is written here: a mutant's truth is by construction, not by a second author, and independence is from the claimant, never from the operator (one). The five records below say what was measured, on this frozen set, on this machine, and nothing more; the holds of the pre-registration — the LLM-judge baseline, outside reruns, the claim-to-statement track, the register gap — stand.
The note was written on 2026-10-20, before any run: the frozen set (the register at sha256 270094aa3c92…, 25 records), the five measurements with their definitions, the two laptop profiles and the hosted one, the mutation classes per record (119 mutable rows), the kill switches per phase, what is claimed and what is not, the holds, the output names. Every record below pins it by sha256; amend the note and every battery refuses until the records are regenerated — on purpose. Two things the note did not foresee are recorded as dated corrections, not silent edits: a stamp rule in the runner that was narrower than the note's (re-derived, no measurement touched), and the invariances a row admits, which must preserve every claim the row decides (negating a truth table flips its monotonicity claim; the class was replaced before the record was written).
The inventory (phase 1): 23 of the 25 records re-derive with one command (125 rows), 7 carry a standard-library verifier (50 rows), 1 a second implementation; 13 commands write their record and 10 only check it; 74 rows carry a per-row timing. The runner (phase 2, Apple M2, v24.14.1, Python 3.9.6, AC 100%): every command of the rerun kit under /usr/bin/time -l, one process at a time, twice under each profile — cold, then warm, never averaged. Under the portable profile the wall of 60 s is enforced by killing the process group at the cap: 5 records were REFUSED for resources (ledger.json (5.7 min, 1 row), horizon-ledger.json (2.2 min, 1 row), hseva-ledger.json (8.6 min, 1 row), gnnw-certificate.json (3.6 min, 1 row), polymaps-ledger.json (1.6 min, 8 rows)), exactly the 5 the inventory had timed over the cap. Under the extended profile every record ran and every one was reproducible: it differed from its pin only at its declared stamps, and the register rebuilt from it moved no row. Peak memory was at most 675 MiB, far from the 4 GiB the profile reports against.
| record | rows | portable, cold · warm | extended, cold · warm | CPU (extended, cold) | peak RSS | reproducible |
|---|---|---|---|---|---|---|
| erdos852-certificate.json | 1 | 5.8 s · 5.6 s | 5.5 s · 5.3 s | 5.3 s | 155 MiB | yes |
| kissing-ledger.json | 11 | 6.6 s · 6.9 s | 6.8 s · 10 s | 7 s | 224 MiB | yes |
| ledger.json | 1 | REFUSED · REFUSED | 5.5 min · 5.5 min | 5.5 min | 284 MiB | yes |
| strassen-certificate.json | 10 | < 1 s · < 1 s | < 1 s · < 1 s | < 1 s | 63 MiB | yes |
| easota-ledger.json | 20 | 3.2 s · 3.4 s | 3.4 s · 3.2 s | 3.3 s | 101 MiB | yes |
| ecbench-ledger.json | 1 | 6.2 s · 5.8 s | 5.8 s · 5.9 s | 6.4 s | 677 MiB | yes |
| gsm8k-ledger.json | 1 | 1.6 s · 1.6 s | 1.6 s · 1.6 s | 1.5 s | 56 MiB | yes |
| horizon-ledger.json | 1 | REFUSED · REFUSED | 2 min · 2.3 min | 13.5 min | 47 MiB | yes |
| hseva-ledger.json | 1 | REFUSED · REFUSED | 8.9 min · 8.7 min | 48 min | 559 MiB | yes |
| design-table-audit.json | 1 | < 1 s · < 1 s | < 1 s · < 1 s | < 1 s | 87 MiB | yes |
| sumdiff-ledger.json | 3 | 1.3 s · 1.2 s | 1.4 s · 1.5 s | 1.5 s | 63 MiB | yes |
| fei-ledger.json | 1 | 2 s · 2 s | 2 s · 2 s | 2 s | 35 MiB | yes |
| sumproduct-ledger.json | 1 | 48.2 s · 39.3 s | 38 s · 37.6 s | 37.7 s | 13 MiB | yes |
| turan-ledger.json | 2 | 1.7 s · 1.7 s | 1.7 s · 1.7 s | 1.6 s | 11 MiB | yes |
| countex-ledger.json | 14 | 34 s · 34.1 s | 34 s · 33.8 s | 33.9 s | 237 MiB | yes |
| horizonmath-ledger.json | 3 | 1.6 s · 1.6 s | 1.6 s · 1.6 s | 1.6 s | 13 MiB | yes |
| gnnw-certificate.json | 1 | REFUSED · REFUSED | 3.4 min · 3.3 min | 3.3 min | 12 MiB | yes |
| polymaps-ledger.json | 8 | REFUSED · REFUSED | 88.8 s · 1.5 min | 86.6 s | 45 MiB | yes |
| mc100-alphatensor-q.json | 12 | < 1 s · < 1 s | < 1 s · < 1 s | < 1 s | 65 MiB | yes |
| mc100-alphatensor-f2.json | 8 | < 1 s · < 1 s | < 1 s · < 1 s | < 1 s | 64 MiB | yes |
| mc100-alphaevolve-nb-matmul.json | 15 | 1.6 s · 1.6 s | 1.6 s · 1.6 s | 1.9 s | 98 MiB | yes |
| mc100-einstein-arena.json | 8 | 48.2 s · 46.7 s | 47.6 s · 56.2 s | 46.9 s | 242 MiB | yes |
| mc100-station-v2.json | 1 | < 1 s · < 1 s | < 1 s · < 1 s | < 1 s | 12 MiB | yes |
One side effect is on the record and was restored each time: make engine rewrites certs/keller-certificate.json with the pins its sources listing has grown since the record was taken — a listing, nothing decided.
A mutant is a case derived from a row's pinned record entry by one named transformation of the note's class table. Its truth is fixed by construction and checked by a witness that shares no code with the decider (Python standard library, exact: Fractions, directed-rounding Decimal, Z[√2], Kronecker convolutions) — a FALSE mutant the witness cannot witness is DISCARDED and counted, never relabelled. The decider under test is the row's own re-derive path with the mutant in place of the pinned bytes; required words: FALSE → REFUTED, TRUE → CERTIFIED (an invariance keeps the original's own word, so a REPAIRED row's rigid motion is REPAIRED again), MALFORMED → REFUSED. The witness carries red controls every run: no violation on a CERTIFIED original or a TRUE mutant, one on the REFUTED original and on every family's control class.
| family | rows | mutants | FALSE · TRUE · MALFORMED | false certifications | false refutations | refusals · discards | rows with a witnessed FALSE | float check accepts the FALSE at 10⁻⁶ · 10⁻⁹ · 10⁻¹² |
|---|---|---|---|---|---|---|---|---|
| tensor | 45 | 315 | 180 · 90 · 45 | 0 | 0 | 3 · 0 | 45 of 45 | 19.4 % · 6.1 % · 0 % |
| kissing | 11 | 69 | 39 · 20 · 10 | 0 | 0 | 0 · 0 | 10 of 11 | 0 % · 0 % · 0 % |
| shapes | 28 | 136 | 80 · 28 · 28 | 0 | 0 | 3 · 27 | 25 of 28 | 77.4 % · 30.2 % · 1.9 % |
| erdos852 | 1 | 5 | 2 · 2 · 1 | 0 | 0 | 0 · 0 | 1 of 1 | 100 % · 100 % · 100 % |
| polymaps | 9 | 35 | 17 · 9 · 9 | 0 | 0 | 0 · 0 | 9 of 9 | 0 % · 0 % · 0 % |
| countex | 14 | not mutated | — | — | — | — | — | — |
| entropy | 4 | 12 | 4 · 4 · 4 | 0 | 0 | 0 · 0 | 4 of 4 | 100 % · 100 % · 100 % |
| turan | 2 | not mutated | — | — | — | — | — | — |
| horizonmath | 3 | not mutated | — | — | — | — | — | — |
| gnnw | 1 | not mutated | — | — | — | — | — | — |
| sumproduct | 1 | not mutated | — | — | — | — | — | — |
Two defects, found and fixed. The campaign's first whole run came back with 28 false certifications and 49 malformed inputs answered REFUTED. The note's rule applied: fixed, recorded beside each mutant with the commit it was found at, the mutant kept, the count reported.
| defect | found | at commit | the word then | as required now | the fix |
|---|---|---|---|---|---|
| easota-word | 28 | d961cda2 | FALSE CERTIFICATION | 28 of 28 | instruments/easota/word.js composes the word in one place: WITNESSED with a printed value the exact value does not reproduce → MISPRINTED → the register's REFUTED, kind not-from-the-published-data, the exact value ce… |
| malformed-word | 49 | d961cda2 | not as required (REFUTED) | 49 of 49 | instruments/strassen/tensor.js: the four shape checks of audit() and of auditZi() answer REFUSED with the same reason (the identity failing under both layouts stays REFUTED); families/strassen-audit.js and tools/run-mc10… |
Still open, on the record: polymaps · exponent-missing → not as required (PARTIAL) × 1 — a partial decision that reads a term with a missing exponent silently (the evaluation zips the point against a short tuple); recorded, not yet fixed. The other outcomes that are not the required word are compositions, each listed in the record: refused 6, DISCARDED 27, not as required (REPAIRED) 17, not as required (UNWITNESSED) 1, not as required (PARTIAL) 1.
Not mutated, a reason per row (21 rows):
| family | rows | why |
|---|---|---|
| countex | 14 | one decider and one artifact shape per case; a witness per case is a campaign of its own; the case's own forge() red control runs every build |
| turan | 2 | a handful of real parameters whose decided conditions are the note's series inequalities; a FALSE witness would re-sum the series with tail bounds (a second implementation, not a witness); no admissible class |
| horizonmath | 3 | the decided fact is a gap between two definitions (the checker's and the theorem's); a mutation of the certificate's numbers does not touch it |
| gnnw | 1 | a FALSE witness would enclose Theorem 14's slack — the verifier's own computation; the second implementation is Phase 4's concordance partner, not a mutation witness |
| sumproduct | 1 | a chain of cited constants and two sweeps, already REPAIRED as printed; a FALSE witness would be the sweep again; no admissible class |
Classes excluded on rows that were mutated (16): tensor · coefficient-times-one-plus-1e-9 × 10 — no meaning over F₂: 1 + 10⁻⁹ is not an element of the field; the class is stated for Q and Z[i]; kissing · contact-sum × 1 — the configuration has no exact contact pair (no two rows at exactly 60°), so the sum of two contact vectors does not exist for it; shapes · printed-plus-one-unit × 1 — the row prints no value (the ledger certifies the exact value with no printed bar), so there is no printed digit to move; shapes · printed-minus-one-unit × 1 — the row prints no value; shapes · coordinate-perturbed-1e-12 × 2 — the hexagons' constraints (separation, containment) are cosines and sines of printed angles; a standard-library witness of a violated constraint would need certified trigonometry, which it does not have; polymaps · coefficient-plus-one × 1 — F7's determinant rests on the paper's lemma (the row is PARTIAL): a coefficient moved changes nothing the decider decides but the collision, which the witness-point class covers.
A double-precision checker written for the audit — no exact arithmetic, a tolerance τ on every constraint and on the bar, the natural numpy-style verification of each family — ran on every original and every mutant. On the 295 witnessed FALSE mutants it ACCEPTED 82 at τ = 10⁻⁶ (27.8 %), 33 at 10⁻⁹ (11.2 %), 7 at 10⁻¹² (2.4 %): a printed value one unit off in its seventh to tenth digit, a coefficient scaled by 1 + 10⁻⁹, a bar one unit above an entropy ratio's last printed digit, the published C* that is the naive double product — each inside what a tolerance admits. And the other side: it confirmed only 94 of the 97 TRUE originals at 10⁻⁶, 81 at 10⁻⁹, 72 at 10⁻¹² — among the polynomial maps, cancellation in float Gaussian elimination over hundreds to tens of thousands of terms puts the determinant past 10⁻⁶ of its constant on four of nine. A tolerance that admits a quarter of the false claims cannot confirm a quarter of the true ones. The exact deciders returned 0 false certifications on the same objects, and every original as the register says.
For every register row decided by two or more programs, the records were read and compared field by field: the word, the witness or the violating-pair count where one exists, the enclosure where one exists. 91 comparisons on 56 rows (40 2 implementations, field by field; 1 4 implementations, field by field; 1 3 implementations, field by field; 49 word-level: a standard-library verifier re-derives the record), 91 concordant, 0 disagreements. Nothing was re-run for this: the second implementations' own runs are on record, and so are the standard-library verifiers' exits in the rerun kit's run.
The hosted profile, carried in as recorded. 416 kernel challenges of the openai-math audit, decided on GitHub-hosted Linux runners (.github/workflows/openai-math-kernel.yml) with two kernels per run: 398 CERTIFIED, 18 REFUSED; wall seconds min 18, median 587, max 12453; peak RSS up to 13715 MiB. 435 runs exceed the laptop's portable wall and 413 its reported memory bound — which is why they are a profile of their own, never merged into the laptop table and never re-run here. The 18 refusals were for resources on the runner and stay refusals.