Skip to content

DAOS-19429 rebuild: debug ec agg and rebuild - #18839

Draft
wangshilong wants to merge 1 commit into
masterfrom
shilongw/DAOS-19429
Draft

DAOS-19429 rebuild: debug ec agg and rebuild#18839
wangshilong wants to merge 1 commit into
masterfrom
shilongw/DAOS-19429

Conversation

@wangshilong

Copy link
Copy Markdown
Contributor

Features: rebuild

Steps for the author:

  • Commit message follows the guidelines.
  • Appropriate Features or Test-tag pragmas were used.
  • Appropriate Functional Test Stages were run.
  • At least two positive code reviews including at least one code owner from each category referenced in the PR.
  • Testing is complete. If necessary, forced-landing label added and a reason added in a comment.

After all prior steps are complete:

  • Gatekeeper requested (daos-gatekeeper added as a reviewer).

@github-actions

Copy link
Copy Markdown

Ticket title is 'daos_test/suite.py:DaosCoreTest.test_daos_rebuild_ec - ranks 0, 5, 7 in excluded state'
Status is 'Open'
Labels: '2.8.0rc3,pr_test,triaged'
https://daosio.atlassian.net/browse/DAOS-19429

@daosbuild3

Copy link
Copy Markdown
Collaborator

Test stage Functional Cluster Box Medium MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/1/execution/node/1605/log

@daosbuild3

Copy link
Copy Markdown
Collaborator

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/1/execution/node/1668/log

Rebuild currently pauses EC aggregation only on each local target, without
waiting for all targets globally. In CI, EC aggregation was observed more
than 90 seconds after rebuild had started pausing it.

Add a global EC aggregation barrier without introducing a new rebuild
phase. Each target reports through the existing rebuild IV after its local
EC aggregation has stopped. Once all participating targets have reported,
the rebuild leader publishes the stable epoch and allows scanning to start.

Features: rebuild
Signed-off-by: Wang Shilong <shilong.wang@hpe.com>
@daosbuild3

Copy link
Copy Markdown
Collaborator

@daosbuild3

Copy link
Copy Markdown
Collaborator

Test stage Functional Hardware Medium Verbs Provider MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/2/execution/node/1705/log

@daosbuild3

Copy link
Copy Markdown
Collaborator

Test stage Functional Hardware Medium MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/2/execution/node/1695/log

@daosbuild3

Copy link
Copy Markdown
Collaborator

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/2/execution/node/1685/log

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants