Commit c0429dd
committed
ci(timings): give the test-timing parser self-test teeth in lint.yml, not continue-on-error in ci.yml
`scripts/report-test-timings.mjs` ships a real self-test — 61 cases across 4
batteries, a naive prefix-only reference parser plus three controls that assert
it gets the answer wrong exactly where the real parser gets it right. ci.yml
named it, so `check:self-test-wired` was green. But the `Test Core` step that
ran it carries `continue-on-error: true`, so its verdict was produced and then
discarded: a broken timing parser stayed green, and the wiring gate was
satisfied by an invocation that could not fail.
That `continue-on-error` cannot simply be removed. #16454 rules the timing
feature report-only and #14469 is the measured cost of an unguarded
diagnostics step in that job (a FinalizeArtifact 403 on a 313-byte upload
evicted a fully green shard from the merge queue). Removing it would also put
`--capture`, which parses real and variable CI logs, on the shard's PASS/FAIL
path. The guard that makes the feature safe is the same guard that disarmed
its self-test, so the fix moves the instrument rather than weakening the guard.
- lint.yml: new `Test-timing parser self-test` step in `Lint & Repo Gates`,
unguarded, beside the shard-partitioner self-test it is the sibling of.
- ci.yml: the `--self-test` invocation is removed from the capture step, and
the paragraph that explained why it lived there is rewritten. `--capture`
and `--merge` keep `continue-on-error`; that property is untouched.
- report-test-timings.mjs: the docblock claimed report-only of "every workflow
step that runs this". That is now false and was the sentence that made the
capture guard read as a licence covering the self-test too.
`check:self-test-wired` stays green with the invocation moved: lint.yml is a
workflow, and the gate credits any workflow that names the script.
Claude-Session: https://claude.ai/code/session_012GKcPZbMoGq7WPzKLfRBTU
Co-authored-by: Claude <noreply@anthropic.com>1 parent 66e34d1 commit c0429dd
3 files changed
Lines changed: 51 additions & 12 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
928 | 928 | | |
929 | 929 | | |
930 | 930 | | |
931 | | - | |
932 | | - | |
933 | | - | |
934 | | - | |
935 | | - | |
936 | | - | |
| 931 | + | |
| 932 | + | |
| 933 | + | |
| 934 | + | |
| 935 | + | |
| 936 | + | |
| 937 | + | |
| 938 | + | |
| 939 | + | |
| 940 | + | |
| 941 | + | |
937 | 942 | | |
938 | 943 | | |
939 | 944 | | |
| |||
942 | 947 | | |
943 | 948 | | |
944 | 949 | | |
945 | | - | |
946 | 950 | | |
947 | 951 | | |
948 | 952 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3943 | 3943 | | |
3944 | 3944 | | |
3945 | 3945 | | |
| 3946 | + | |
| 3947 | + | |
| 3948 | + | |
| 3949 | + | |
| 3950 | + | |
| 3951 | + | |
| 3952 | + | |
| 3953 | + | |
| 3954 | + | |
| 3955 | + | |
| 3956 | + | |
| 3957 | + | |
| 3958 | + | |
| 3959 | + | |
| 3960 | + | |
| 3961 | + | |
| 3962 | + | |
| 3963 | + | |
| 3964 | + | |
| 3965 | + | |
| 3966 | + | |
| 3967 | + | |
| 3968 | + | |
| 3969 | + | |
| 3970 | + | |
3946 | 3971 | | |
3947 | 3972 | | |
3948 | 3973 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
26 | 36 | | |
27 | 37 | | |
28 | 38 | | |
| |||
0 commit comments