DAOS-19429 rebuild: debug ec agg and rebuild - #18839
Conversation
|
Ticket title is 'daos_test/suite.py:DaosCoreTest.test_daos_rebuild_ec - ranks 0, 5, 7 in excluded state' |
|
Test stage Functional Cluster Box Medium MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/1/execution/node/1605/log |
|
Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/1/execution/node/1668/log |
Rebuild currently pauses EC aggregation only on each local target, without waiting for all targets globally. In CI, EC aggregation was observed more than 90 seconds after rebuild had started pausing it. Add a global EC aggregation barrier without introducing a new rebuild phase. Each target reports through the existing rebuild IV after its local EC aggregation has stopped. Once all participating targets have reported, the rebuild leader publishes the stable epoch and allows scanning to start. Features: rebuild Signed-off-by: Wang Shilong <shilong.wang@hpe.com>
bab2ee1 to
1d4e28a
Compare
|
Test stage Functional on EL 9 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/2/execution/node/1264/log |
|
Test stage Functional Hardware Medium Verbs Provider MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/2/execution/node/1705/log |
|
Test stage Functional Hardware Medium MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/2/execution/node/1695/log |
|
Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-18839/2/execution/node/1685/log |
Features: rebuild
Steps for the author:
After all prior steps are complete: