Skip to content

feat(datafusion): support snapshot time travel for external engines - #1113

Merged
JingsongLi merged 7 commits into
apache:mainfrom
plusplusjiajia:feat/engine-time-travel
Oct 13, 2026
Merged

JingsongLi merged 7 commits into
apache:mainfrom
plusplusjiajia:feat/engine-time-travel

Conversation

@plusplusjiajia

@plusplusjiajia plusplusjiajia commented Oct 12, 2026 •

Copy link
Copy Markdown
Member

Purpose

Support VERSION AS OF <snapshot_id> for registered external table engines through SQLContext and DataFusion SessionContext.

SQLContext resolves snapshots even when the current provider cannot be loaded. Raw SessionContext preloads the current provider and propagates its errors.

Follow-up to #1100.

Brief change log

  • Resolve external snapshot queries with the corresponding historical schema.
  • Preserve resolver errors from direct DataFusion table lookups.
  • Preserve read-only enforcement and native Paimon time-travel behavior.
  • Add regression tests and update the DataFusion README.

Tests

  • 531 DataFusion unit and integration tests passed.
  • Clippy passed with warnings denied.
  • Formatting and diff checks passed.

@plusplusjiajia
plusplusjiajia marked this pull request as ready for review October 13, 2026 06:33
@JingsongLi
JingsongLi merged commit 024739c into apache:main Oct 13, 2026
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants