Skip to content

Single ZK node fate data #4905

Description

@kevinrr888

Is your feature request related to a problem? Please describe.
For MetaFateStore, it would be beneficial to have all the data associated with a fate id in a single ZooKeeper node. This allows for atomic updates to a fate id. This will be slower than the current implementation. We are trading some speed for correctness. However, since this is only used for the tables in the accumulo namespace (ROOT, METADATA, FATE, SCAN_REF), this is a good tradeoff. In previous versions (before 4.x), MetaFateStore (aka ZooStore) was used for all transactions, so this change wasn't practical. With this change, it would also be nice to serialize the data as JSON allowing for easier serialization and deserialization and for better readability.

Additional context
#4524 (comment)
#4524 (comment)

Metadata

Metadata

Assignees

Labels

enhancementThis issue describes a new feature, improvement, or optimization.

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions