Describe the feature
Extend the batch incremental scan API to read existing changelog files from snapshots (changelog_manifest_list), and expose an AuditLogTable-style read that surfaces row kinds as +I / -U / +U / -D.
Motivation
Tables written with changelog-producer=input (and other producers that already materialize changelog files) should be readable incrementally without generating changelog on the Rust side.
Proposed scope
- Changelog planning over snapshots in
(start, end]
- Skip OVERWRITE / missing changelog lists cleanly
AuditLogTable (or equivalent) with rowkind as the first column- Tests with input-changelog fixtures (no compact/lookup generation in this PR)
Depends on the Delta/Auto incremental API landing first.
Out of scope
- Generating lookup/compact changelogs in Rust
- Diff mode (derive changelog by comparing before/after images)
Describe the feature
Extend the batch incremental scan API to read existing changelog files from snapshots (
changelog_manifest_list), and expose anAuditLogTable-style read that surfaces row kinds as+I/-U/+U/-D.Motivation
Tables written with
changelog-producer=input(and other producers that already materialize changelog files) should be readable incrementally without generating changelog on the Rust side.Proposed scope
(start, end]AuditLogTable(or equivalent) withrowkindas the first columnDepends on the Delta/Auto incremental API landing first.
Out of scope