Axiom / Operations

Encoding operations

Stages

INGESTSTARTENCODELANDSERVEIN PARALLEL2 reached Release publish1 reached Release activate1 reached Release pin32 reached Signing approval32 reached Setup29 reached Validate10 reached Sign & open PR1 reached Review1 reached Merge1 reached Tests on main1 reached Compile1 left Release activate1 left Release pin32 reached Dispatch27 reached Generate7 reached PR checks1 reached Index↺ 60 retriesCorpus ingest: Source documents enter axiom-corpus: the PR a release is cut from, open to merge.CORPUS INGEST2100% passedRelease publish: axiom-corpus's publish run signs and uploads the release. One visit per run.RELEASE PUBLISH2100% passedRelease activate: A person activates the release: the site serves it.RELEASE ACTIVATE · PERSON1no finished visitsRelease pin: The jurisdiction's rulespec repo pins the release, or a later one, in .axiom/toolchain.toml: the pin lag.RELEASE PIN · PERSON1100% passedDispatch: A targeted re-encode run is queued.DISPATCH32100% passedSigning approval: The production-signing environment waits for a person.SIGNING APPROVAL · PERSON32100% passed · 3.3hSetup: Checkouts, corpus fetch and identity checks before the encoder runs.SETUP3291% passed · 6mMain reason: Fetch pinned corpus provision objects (2)3 left the lineTarget gate: The encoder's pre-encode gate stops an empty or repealed target before a model call. Not measured: gate not live yet.TARGET GATE—not measuredgate not live yetGenerate: The model writes a candidate. One visit per try.GENERATE27100% passed · 25sValidate: Checks judge the candidate. A failed try loops back to Generate.VALIDATE2934% passed · 4mtries: 11 of 88 passedMain reason: Complete source unit: deferral (5)19 left the lineSign & open PR: Package, sign, and open the manifest PR.SIGN & OPEN PR1070% passed · 24sMain reason: Verify generated provenance (2)3 left the linePR checks: CI on the signed manifest PR.PR CHECKS714% passedMain reason: Check failed: reverse-index (4)6 left the lineReview: Review and the merge decision.REVIEW · PERSON1100% passedMerge: Into the default branch, directly or through a side branch's PR.MERGE · PERSON1100% passedIndex: The rulespec_files sync picks the module up.INDEX1100% passedTests on main: The jurisdiction's validation on the default branch.TESTS ON MAIN1100% passedCompile: axiom-api's nightly compile sweep.COMPILE1100% passed
line width: cases that reached the stage a person acts left the line there not measured yet
StageReachedResultPassed by weekMedianp95Open nowMain reason a case left
Ingest
Corpus ingest2100%1 weeknot measured
Release publish2100%1 weeknot measured
Release activate1–not measured3
Release pin1100%1 weeknot measured1
Start
Dispatch32100%1 week
Signing approval32100%2026-11-02: 30 of 30 passed 2026-11-09: 2 of 2 passed3.3h37h
Setup3291%2026-11-02: 27 of 30 passed 2026-11-09: 2 of 2 passed6m37mFetch pinned corpus provision objects · 2
Target gate–not measuredGate not live yet
Encode
Generate27100% · tries 100%2026-11-02: 79 of 79 passed 2026-11-09: 8 of 8 passed25s50s
Validate2934% · tries 13%2026-11-02: 10 of 82 passed 2026-11-09: 1 of 8 passed4m10mComplete source unit: deferral · 5
Sign & open PR1070%2026-11-02: 6 of 9 passed 2026-11-09: 1 of 1 passed24s11mVerify generated provenance · 2
Land
PR checks714%2026-11-02: 1 of 6 passed 2026-11-09: 0 of 1 passednot measuredCheck failed: reverse-index · 4
Review1100%1 weeknot measured1
Merge1100%1 weeknot measured6
Serve
Index1100%1 weeknot measured
Tests on main1100%1 weeknot measured26
Compile1100%not measured4

passedfailedcancelledstill there a person acts at this stage

Failure classes

Encode cases that failed in the window, by who owns the fix

ClassOwnerFailed casesClassified byMain reason
Validator rejected the outputEncoder or validator13 · 45%stage or rule 9 · error text 4Validate: Complete source unit: deferral · 5
Migration debtEngine and toolchain6 · 21%error text 6Validate: External source replacement must preserve the · 3
Policy or process blockPolicy review2 · 7%error text 2Sign & open PR: Verify generated provenance · 2
Infra or transientInfra2 · 7%error text 2Setup: Fetch pinned corpus provision objects · 2
Not classified–6 · 21%–PR checks: Check failed: reverse-index · 4

A rejected try is an encoder error or a validator false positive; the data cannot split them yet. Encoders from axiom-encode #1997 on record their own class, and that class comes first.

Where the time goes

Summed time of finished visits at each stage

Corpus ingest5.6h · 2 visits
Release publish9m · 2 visits
Release pin45h · 1 visits
Signing approval11d · 32 visits
Setup6.0h · 32 visits
Generate36m · 84 visits
Validate7.3h · 87 visits
Sign & open PR39m · 10 visits
Review59m · 1 visits
Index35m · 1 visits
Tests on main25m · 1 visits

Encode loop

Tries that passed validation, by try number

Try 1 · gpt-6-luna21% · 6 of 28 · $0.22
Try 2 · gpt-6-luna0% · 0 of 21 · $0.12
Try 3 · gpt-6-sol14% · 3 of 21 · $3.84
Try 4 · gpt-6-sol11% · 2 of 18 · $1.27

Validator rules

Rules that rejected tries in the window, most tries first

RuleTriesRunsNext try fails it againPassed later
Complete source unit: deferral17773% · 8 of 111
External source replacement must preserve the123100% · 9 of 90
Complete source unit: tests105100% · 5 of 54
Axiom rules engine compile failed failed8467% · 4 of 60
Complete source unit: structure7367% · 4 of 61
Ungrounded generated numeric literal does not52100% · 3 of 31
Test case execution failed missing input4267% · 2 of 31
Complete source unit: numeric recall32100% · 1 of 11
Complete source unit: source explicit conditions3150% · 1 of 20
Test case output expected integer got21100% · 1 of 11

Validator rules by week

Share of runs with a try that hit the rule

Complete source unit: deferral
2026-11-02: 7 of 31 runs23%11-0211-02

No citation run again 7+ days later

External source replacement must preserve the
2026-11-02: 3 of 31 runs10%11-0211-02

No citation run again 7+ days later

Complete source unit: tests
2026-11-02: 5 of 31 runs16%11-0211-02

No citation run again 7+ days later

What the data covers

  • 32 dispatched runs: 27 have per-try records (recorded since 2026-09-13), 24 have a model cost.
  • Time not measured: Corpus ingest, Release publish, Release pin, Release activate, PR checks, Review, Merge, Index, Tests on main, Compile.
  • Not measured: Target gate (gate not live yet).
  • 2 corpus releases in the window. Corpus ingest is the axiom-corpus PR a release is cut from, open to merge; Release publish is each run of its publish workflow; Release activate is its first activation (corpus.scope_activation_history); Release pin runs from the upload to the first pin in its rulespec repo's .axiom/toolchain.toml of it or of a release signed after it (superseded).
  • Window 2026-11-02 to 2026-11-09 · 28,308 events · read 2026-11-09 16:09 UTC.