Repository navigation

Stronger, clearer test suite with cross-engine verification - #195

Merged

AndrewSazonov merged 57 commits into

developfrom

test-suite-and-validation

Jun 7, 2026

Merged

Stronger, clearer test suite with cross-engine verification#195
AndrewSazonov merged 57 commits into
developfrom
test-suite-and-validation

Commits on Jun 5, 2026
- Add test-suite-and-validation ADR suggestion
  AndrewSazonov
  committed
  5084800
- Update test-suite-and-validation ADR and index from review
  AndrewSazonov
  committed
  472a0dd
- Add test-suite-and-validation implementation plan
  AndrewSazonov
  committed
  c4d0532
- Make codecov patch informational and gate project at 80%
  AndrewSazonov
  committed
  36609da
- Replace fast marker with pr and nightly test tiers
  AndrewSazonov
  committed
  4db5ee9
- Select test tiers per trigger across all test layers
  AndrewSazonov
  committed
  f1710a7
- Gate unit-test structure check on shared src tree walk
  AndrewSazonov
  committed
  29701b7
- Document strict test layer placement criteria
  AndrewSazonov
  committed
  8f68124
- Relocate network and engine tests to correct layers
  AndrewSazonov
  committed
  906f20d
- Document integration layer defaults to pr tier
  AndrewSazonov
  committed
  6bfc73d
- Add hypothesis deterministic profile and shared test fixtures
  AndrewSazonov
  committed
  31f8882
Commits on Jun 6, 2026
- Add property-based input-domain tests for validators
  AndrewSazonov
  committed
  146ad57
- Raise coverage fail_under to 80 percent
  AndrewSazonov
  committed
  dc90a36
- Add strict docs build and spell check on every push
  AndrewSazonov
  committed
  aacc3e6
- Add calculator support matrix query for verification
  AndrewSazonov
  committed
  60b7d8a
- Add cross-engine verification comparison pages and script wiring
  AndrewSazonov
  committed
  8cc7e2a
- Add per-experiment performance benchmarks (nightly)
  AndrewSazonov
  committed
  0c9ffb7
- Record cross-repo nightly harness and benchmarks as future work
  AndrewSazonov
  committed
  2dcb98d
- Promote test-suite-and-validation ADR to accepted
  AndrewSazonov
  committed
  d025df7
- Reach Phase 1 review gate
  AndrewSazonov
  committed
  78450c4
- Run pr tier on pull_request events, not only main branches
  AndrewSazonov
  committed
  a2a23a3
- Share excluded-dirs set between structure check and docs
  AndrewSazonov
  committed
  7ccd28f
- Add lychee link check to the docs gate
  AndrewSazonov
  committed
  5edcc7b
- Run verification notebooks in notebook test and exec tasks
  AndrewSazonov
  committed
  f9a1730
- Assert explicit tolerances for all verification metrics
  AndrewSazonov
  committed
  0262ed3
- Run full suite across all tiers in the nightly workflow
  AndrewSazonov
  committed
  eb3aee0
- Scope verification to CWL powder now, defer rest to issue 115
  AndrewSazonov
  committed
  7d02a24
- Lint and format verification pages like tutorials
  AndrewSazonov
  committed
  64168ae
- Apply pixi run fix auto-fixes and resolve lint findings
  AndrewSazonov
  committed
  81e521d
- Tighten cross-engine verification tolerances from measurement
  AndrewSazonov
  committed
  7ce29db
- Render small canvas in raster tests to speed them up
  AndrewSazonov
  committed
  4f4de17
- Add icon to the Verification docs section
  AndrewSazonov
  committed
  83bd6a5
- Fix tabel typo in docs CSS comments
  AndrewSazonov
  committed
  ede35b7
- Fix promoted ADR links to documentation-ci-build
  AndrewSazonov
  committed
  9bc03a2
- Scope codespell and lychee to pass on real sources
  AndrewSazonov
  committed
  54b6d48
- Run docs checks (spell, link, strict build) with the checks
  AndrewSazonov
  committed
  bb2c967
- Reflow ADR prose after link fix
  AndrewSazonov
  committed
  2dbb6f0
- Make check static-only and add full pre-PR all task
  AndrewSazonov
  committed
  2f2a40d
- Always build docs strictly; drop docs-build-strict
  AndrewSazonov
  committed
  c1afbd2
- Gate docstring coverage as a check, not in coverage.yml
  AndrewSazonov
  committed
  aee2a76
- Restore logger reaction mode in validation-properties test
  AndrewSazonov
  committed
  5046b05
- Expand unit-test coverage across analysis, display, report
  AndrewSazonov
  committed
  6950251
- Add coverage tests for tex_renderer, iucr_writer, serialize, tracking
  AndrewSazonov
  committed
  c292d89
- Add coverage tests for project display, logging, utils, experiment item
  AndrewSazonov
  committed
  a1c244f
- Add coverage tests for plotting, analysis, plotly, project
  AndrewSazonov
  committed
  173ce6f
- Add coverage tests for sequential, environment, sidecar, collection
  AndrewSazonov
  committed
  ef8b055
- Add docstrings across analysis, datablocks, display modules
  AndrewSazonov
  committed
  e79388d
- Fix diagonal-shape call in single-crystal predictive plot
  AndrewSazonov
  committed
  71b2351
- Make relative-destination zip test hermetic
  AndrewSazonov
  committed
  a69f246
- Harden unit-test gate: random order, state reset, 88% floor
  AndrewSazonov
  committed
  71bc681
- Fix two unit tests that relied on leaked WARN logger mode
  AndrewSazonov
  committed
  2f1876e
- Add open issue: static type checker in the quality gate
  AndrewSazonov
  committed
  be9fd20
- Record pytest-randomly dependency approval in the plan
  AndrewSazonov
  committed
  4304821
- Skip integration tests on the fast tier instead of failing
  AndrewSazonov
  committed
  218742b
- Fix two Windows-only failures in coverage tests
  AndrewSazonov
  committed
  990e681
- Use in-memory HDF5 for low-level sidecar unit tests
  AndrewSazonov
  committed
  0754105
- Scope display_path relative_to patch to the target only
  AndrewSazonov
  committed
  d0f8f99

Commits

Commits on Jun 5, 2026

Commits on Jun 6, 2026