Axiom / Operations

Encoding operations

Stages

INGESTSTARTENCODELANDSERVEIN PARALLEL16 reached Release publish4 reached Release activate12 reached Release pin94 reached Signing approval91 reached Setup76 reached Validate28 reached Sign & open PR8 reached Review7 reached Merge5 reached Tests on main5 reached Compile4 left Release activate12 left Release pin95 reached Dispatch74 reached Generate18 reached PR checks5 reached Index↺ 109 retriesCorpus ingest: Source documents enter axiom-corpus: the PR a release is cut from, open to merge.CORPUS INGEST16100% passed · 3.1hRelease publish: axiom-corpus's publish run signs and uploads the release. One visit per run.RELEASE PUBLISH16100% passed · 14mtries: 16 of 18 passedRelease activate: A person activates the release: the site serves it.RELEASE ACTIVATE · PERSON4100% passedRelease pin: The jurisdiction's rulespec repo pins the release, or a later one, in .axiom/toolchain.toml: the pin lag.RELEASE PIN · PERSON12100% passed · 22hDispatch: A targeted re-encode run is queued.DISPATCH95100% passedSigning approval: The production-signing environment waits for a person.SIGNING APPROVAL · PERSON9496% passed · 17mMain reason: Cancelled while it waited for the signing approval (4)4 left the lineSetup: Checkouts, corpus fetch and identity checks before the encoder runs.SETUP9179% passed · 6mMain reason: Fetch pinned corpus provision objects (5)19 left the lineTarget gate: The encoder's pre-encode gate stops an empty or repealed target before a model call. Not measured: gate not live yet.TARGET GATE—not measuredgate not live yetGenerate: The model writes a candidate. One visit per try.GENERATE74100% passed · 30sValidate: Checks judge the candidate. A failed try loops back to Generate.VALIDATE7636% passed · 4mtries: 24 of 186 passedMain reason: Complete source unit: deferral (7)49 left the lineSign & open PR: Package, sign, and open the manifest PR.SIGN & OPEN PR2854% passed · 23sMain reason: The run passed but opened no PR (8)12 left the linePR checks: CI on the signed manifest PR.PR CHECKS1844% passedMain reason: Check failed: validate / validate (us-ak) (6)10 left the lineReview: Review and the merge decision.REVIEW · PERSON8100% passedMerge: Into the default branch, directly or through a side branch's PR.MERGE · PERSON771% passedMain reason: Merged into a side branch that is not on main yet (2)2 left the lineIndex: The rulespec_files sync picks the module up.INDEX5100% passedTests on main: The jurisdiction's validation on the default branch.TESTS ON MAIN5100% passedCompile: axiom-api's nightly compile sweep.COMPILE5100% passedOracle: The axiom-oracles comparison against a reference model.ORACLE0no finished visits
line width: cases that reached the stage a person acts left the line there not measured yet
StageReachedResultPassed by weekMedianp95Open nowMain reason a case left
Ingest
Corpus ingest16100%2026-10-05: 1 of 1 passed 2026-10-12: 3 of 3 passed 2026-10-19: 9 of 9 passed 2026-10-26: 1 of 1 passed 2026-11-02: 2 of 2 passed3.1h2.4d
Release publish16100% · tries 89%2026-10-05: 1 of 1 passed 2026-10-12: 3 of 3 passed 2026-10-19: 9 of 11 passed 2026-10-26: 1 of 1 passed 2026-11-02: 2 of 2 passed14m4.0h
Release activate4100%1 weeknot measured3
Release pin12100%2026-10-12: 3 of 3 passed 2026-10-19: 5 of 5 passed 2026-10-26: 3 of 3 passed 2026-11-02: 1 of 1 passed22h2.8d1
Start
Dispatch95100%2026-10-05: 9 of 9 passed 2026-10-12: 19 of 19 passed 2026-10-19: 17 of 17 passed 2026-10-26: 18 of 18 passed 2026-11-02: 32 of 32 passed
Signing approval9496%2026-10-05: 6 of 6 passed 2026-10-12: 16 of 20 passed 2026-10-19: 18 of 18 passed 2026-10-26: 18 of 18 passed 2026-11-02: 30 of 30 passed 2026-11-09: 2 of 2 passed17m2.2dCancelled while it waited for the signing approval · 4
Setup9179%2026-10-05: 6 of 6 passed 2026-10-12: 14 of 17 passed 2026-10-19: 11 of 18 passed 2026-10-26: 12 of 18 passed 2026-11-02: 27 of 30 passed 2026-11-09: 2 of 2 passed6m20mFetch pinned corpus provision objects · 5
Target gate–not measuredGate not live yet
Encode
Generate74100% · tries 100%2026-10-05: 21 of 21 passed 2026-10-12: 34 of 34 passed 2026-10-19: 21 of 21 passed 2026-10-26: 25 of 25 passed 2026-11-02: 91 of 91 passed 2026-11-09: 8 of 8 passed30s54s
Validate7636% · tries 13%2026-10-05: 0 of 21 passed 2026-10-12: 7 of 35 passed 2026-10-19: 3 of 21 passed 2026-10-26: 5 of 26 passed 2026-11-02: 14 of 94 passed 2026-11-09: 1 of 8 passed4m10mComplete source unit: deferral · 7
Sign & open PR2854%2026-10-12: 5 of 7 passed 2026-10-19: 0 of 3 passed 2026-10-26: 0 of 4 passed 2026-11-02: 8 of 11 passed 2026-11-09: 1 of 1 passed23s10m9The run passed but opened no PR · 8
Land
PR checks1844%2026-10-05: 3 of 3 passed 2026-10-12: 4 of 6 passed 2026-11-02: 1 of 8 passed 2026-11-09: 0 of 1 passednot measuredCheck failed: validate / validate (us-ak) · 6
Review8100%2026-10-05: 3 of 3 passed 2026-10-12: 3 of 3 passed 2026-11-02: 1 of 1 passednot measured1
Merge771%2026-10-05: 3 of 3 passed 2026-10-12: 1 of 3 passed 2026-11-02: 1 of 1 passednot measured6Merged into a side branch that is not on main yet · 2
Serve
Index5100%2026-10-05: 3 of 3 passed 2026-10-12: 1 of 1 passed 2026-11-02: 1 of 1 passednot measured
Tests on main5100%2026-10-05: 3 of 3 passed 2026-10-12: 1 of 1 passed 2026-11-02: 1 of 1 passednot measured68
Compile5100%not measured4
Oracle0–not measured1

passedfailedcancelledstill there a person acts at this stage

Failure classes

Encode cases that failed in the window, by who owns the fix

ClassOwnerFailed casesClassified byMain reason
Validator rejected the outputEncoder or validator36 · 40%stage or rule 19 · error text 17Validate: Complete source unit: deferral · 7
Migration debtEngine and toolchain14 · 16%error text 14PR checks: Check failed: validate / validate (us-ak) · 4
Infra or transientInfra9 · 10%error text 9Setup: Fetch pinned corpus provision objects · 5
Policy or process blockPolicy review8 · 9%error text 8PR checks: Check failed: validate / validate (us-ak) · 2
Encoder errorEncoder1 · 1%error text 1Validate: Valueerror repair artifact is not a · 1
Not classified–22 · 24%–Sign & open PR: The run passed but opened no PR · 8

A rejected try is an encoder error or a validator false positive; the data cannot split them yet. Encoders from axiom-encode #1997 on record their own class, and that class comes first.

Where the time goes

Summed time of finished visits at each stage

Corpus ingest10d · 16 visits
Release publish13h · 18 visits
Release activate20h · 2 visits
Release pin13d · 12 visits
Signing approval34d · 94 visits
Setup12h · 91 visits
Generate1.5h · 180 visits
Validate13h · 189 visits
Sign & open PR46m · 26 visits
Review3.0d · 7 visits
Index6.8h · 5 visits
Tests on main1.8h · 5 visits

Encode loop

Tries that passed validation, by try number

Try 1 · gpt-6-luna19% · 11 of 59 · $0.51
Try 2 · gpt-6-luna2% · 1 of 47 · $0.25
Try 3 · gpt-6-sol22% · 10 of 45 · $8.33
Try 4 · gpt-6-sol6% · 2 of 35 · $2.70

Validator rules

Rules that rejected tries in the window, most tries first

RuleTriesRunsNext try fails it againPassed later
Complete source unit: deferral221071% · 10 of 141
Complete source unit: tests169100% · 7 of 75
Axiom rules engine compile failed failed15773% · 8 of 110
Proof source evidence not found12830% · 3 of 101
External source replacement must preserve the123100% · 9 of 90
Complete source unit: source explicit conditions11543% · 3 of 70
Ungrounded generated numeric literal does not8467% · 4 of 62
Complete source unit: formula output8457% · 4 of 71
Test case execution failed missing input7380% · 4 of 51
Complete source unit: structure7367% · 4 of 61

Validator rules by week

Share of runs with a try that hit the rule

Complete source unit: tests
2026-11-02: 5 of 31 runs16%11-0211-02

No citation run again 7+ days later

Complete source unit: deferral
2026-11-02: 7 of 31 runs23%11-0211-02

No citation run again 7+ days later

External source replacement must preserve the
2026-11-02: 3 of 31 runs10%11-0211-02

No citation run again 7+ days later

Axiom rules engine compile failed failed
2026-11-02: 4 of 31 runs13%11-0211-02

No citation run again 7+ days later

Complete source unit: source explicit conditions
2026-11-02: 1 of 31 runs3%11-0211-02

Run again 7+ days later: 0 of 1 citations still hit it

Proof source evidence not found
2026-11-02: 2 of 31 runs6%11-0211-02

Run again 7+ days later: 0 of 1 citations still hit it

What the data covers

  • 95 dispatched runs: 52 have per-try records (recorded since 2026-09-13), 49 have a model cost.
  • Time not measured: Release activate, PR checks, Review, Merge, Index, Tests on main, Compile, Oracle.
  • Not measured: Target gate (gate not live yet).
  • 16 corpus releases in the window. Corpus ingest is the axiom-corpus PR a release is cut from, open to merge; Release publish is each run of its publish workflow; Release activate is its first activation (corpus.scope_activation_history); Release pin runs from the upload to the first pin in its rulespec repo's .axiom/toolchain.toml of it or of a release signed after it (superseded).
  • Window 2026-10-10 to 2026-11-09 · 28,308 events · read 2026-11-09 15:57 UTC.