Axiom / Operations
Encoding operations
Stages
| Stage | Reached | Result | Passed by week | Median | p95 | Open now | Main reason a case left |
|---|---|---|---|---|---|---|---|
| Ingest | |||||||
| Corpus ingest | 67 | 100% | 37m | 6.5d | |||
| Release publish | 67 | 100% · tries 91% | 5m | 1.8h | |||
| Release activate | 15 | 100% | 1.0h | 16h | 3 | ||
| Release pin | 47 | 100% | 1.2h | 24d | 1 | ||
| Start | |||||||
| Dispatch | 1,067 | 100% | |||||
| Signing approval | 1,046 | 98% | 1m | 5.7h | Cancelled while it waited for the signing approval · 20 | ||
| Setup | 1,047 | 93% | 3m | 6m | Enforce failed attempt budget · 19 | ||
| Target gate | – | not measured | Gate not live yet | ||||
| Encode | |||||||
| Generate | 967 | 100% · tries 100% | 35s | 1m | |||
| Validate | 971 | 34% · tries 9% | 2m | 10m | Complete source unit: deferral · 122 | ||
| Sign & open PR | 329 | 93% | 13s | 44s | The run passed but opened no PR · 17 | ||
| Land | |||||||
| PR checks | 305 | 16% | not measured | Check failed: validate / validate (dk) · 151 | |||
| Review | 48 | 79% | 26m | 40d | 1 | Review: closed unmerged · 10 | |
| Merge | 37 | 95% | not measured | 6 | Merged into a side branch that is not on main yet · 2 | ||
| Serve | |||||||
| Index | 35 | 26% | not measured | Merged, but no indexed module matches the merge commit · 26 | |||
| Tests on main | 35 | 100% | not measured | 26 | |||
| Compile | 9 | 80% | not measured | 4 | Compile: exec error · 1 | ||
passedfailedcancelledstill there a person acts at this stage
Failure classes
Encode cases that failed in the window, by who owns the fix
| Class | Owner | Failed cases | Classified by | Main reason |
|---|---|---|---|---|
| Validator rejected the output | Encoder or validator | 502 · 49% | stage or rule 336 · error text 166 | Validate: Complete source unit: deferral · 122 |
| Policy or process block | Policy review | 230 · 22% | stage or rule 10 · error text 220 | PR checks: Check failed: validate / validate (dk) · 144 |
| Migration debt | Engine and toolchain | 42 · 4% | error text 42 | Validate: Axiom rules engine compile failed failed · 11 |
| Encoder error | Encoder | 34 · 3% | error text 34 | Validate: Valueerror repair artifact metadata mismatch ato · 5 |
| Infra or transient | Infra | 12 · 1% | error text 12 | Setup: Fetch pinned corpus provision objects · 5 |
| Corpus gap | Corpus | 5 · 0% | error text 5 | Validate: Valueerror no local corpus source text · 5 |
| Wrong target | Queue selection | 3 · 0% | error text 3 | Validate: Axiom encode corpus resolver invalidactivecorpus · 3 |
| Not classified | – | 195 · 19% | – | PR checks: A check failed; the record does not name it · 56 |
A rejected try is an encoder error or a validator false positive; the data cannot split them yet. Encoders from axiom-encode #1997 on record their own class, and that class comes first.
Where the time goes
Summed time of finished visits at each stage
Encode loop
Tries that passed validation, by try number
Validator rules
Rules that rejected tries in the window, most tries first
| Rule | Tries | Runs | Next try fails it again | Passed later |
|---|---|---|---|---|
| Complete source unit: tests | 186 | 91 | 80% · 87 of 109 | 11 |
| Proof source evidence not found | 182 | 121 | 32% · 50 of 157 | 41 |
| Complete source unit: structure | 116 | 49 | 70% · 62 of 88 | 7 |
| Axiom rules engine compile failed failed | 103 | 42 | 76% · 60 of 79 | 1 |
| Complete source unit: deferral | 99 | 43 | 75% · 49 of 65 | 1 |
| Complete source unit: numeric recall | 81 | 58 | 31% · 17 of 54 | 23 |
| Complete source unit: formula output | 48 | 21 | 69% · 27 of 39 | 1 |
| Complete source unit: source explicit conditions | 33 | 20 | 44% · 8 of 18 | 0 |
| Ungrounded generated numeric literal does not | 32 | 18 | 70% · 14 of 20 | 3 |
| Test case output expected holds got | 31 | 25 | 29% · 6 of 21 | 4 |
Validator rules by week
Share of runs with a try that hit the rule
Run again 7+ days later: 0 of 3 citations still hit it
Run again 7+ days later: 1 of 2 citations still hit it
Run again 7+ days later: 0 of 4 citations still hit it
Run again 7+ days later: 1 of 2 citations still hit it
Run again 7+ days later: 1 of 8 citations still hit it
No citation run again 7+ days later
What the data covers
- 1,067 dispatched runs: 231 have per-try records (recorded since 2026-09-13), 253 have a model cost.
- Time not measured: PR checks, Merge, Index, Tests on main, Compile.
- Not measured: Target gate (gate not live yet).
- 67 corpus releases in the window. Corpus ingest is the axiom-corpus PR a release is cut from, open to merge; Release publish is each run of its publish workflow; Release activate is its first activation (corpus.scope_activation_history); Release pin runs from the upload to the first pin in its rulespec repo's .axiom/toolchain.toml of it or of a release signed after it (superseded).
- Time measured for part of the visits: Validate 23%.
- Window 2026-08-11 to 2026-11-09 · 28,308 events · read 2026-11-09 16:09 UTC.