Skip to content

Whole-suite history chart: subtract /encoding/ from the run totals - #26

Merged
nicoburns merged 2 commits into
mainfrom
devin/1789944212-root-history-exclude-encoding
Sep 21, 2026
Merged

nicoburns merged 2 commits into
mainfrom
devin/1789944212-root-history-exclude-encoding

Conversation

@nicoburns

@nicoburns nicoburns commented Sep 20, 2026 •

Copy link
Copy Markdown
Member

Summary

On /wpt?range=all browser lines went to ~200%: the whole-suite union total from the comparison DB (~1.12M subtests) leaves out /encoding/ (which the ingester skips as very large and not layout-relevant), but browser-wpt-results' total.json counts it (~1.15M subtests on its own), so passed counts exceeded the denominator.

Fix: the whole-suite history is now total.json − areas/encoding.json per run, so it covers the same tests as the DB total it is divided by.

// wpt_summaries
SummaryCacheEntry::total_history_without_encoding(product, union_total)
// = history("") with each run's ScoreTuple reduced by that run's encoding tuple
//   (run missing encoding data => no score; product with no encoding file,
//   i.e. Blitz => unchanged)

// main.rs compare_history: used when area == "", and the encoding area is
// added to the summary requests for each product

Sanity check with current data: Chrome 2,269,986 − 1,152,348 = 1,117,638 vs DB union total 1,119,347 → 99.8%.

Link to Devin session: https://dioxus.staging.devinenterprise.com/sessions/6a70291c2fd54da1a02968bb80f8622b
Open in Devin Desktop: https://dioxus.staging.devinenterprise.com/desktop/session/6a70291c2fd54da1a02968bb80f8622b?variant=devin-insiders
Requested by: @nicoburns

@staging-devin-ai-integration

Copy link
Copy Markdown

I'll fix CI failures and address comments from users with write access that start with 'DevinAI' or '@devin'.

  • Disable automatic comment, CI, and merge conflict monitoring

@staging-devin-ai-integration staging-devin-ai-integration Bot changed the title Whole-suite history chart: subtract areas excluded from the comparison database Whole-suite history chart: subtract /encoding/ from the run totals Sep 21, 2026
@nicoburns
nicoburns merged commit c5e4217 into main Sep 21, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant