Repository navigation

[codex] Prototype frontier scans and compare DuckDB against V1 - #9884

Closed

joseph-isaacs wants to merge 75 commits into

ji/push-frontier-all-bench

Closed

[codex] Prototype frontier scans and compare DuckDB against V1#9884
joseph-isaacs wants to merge 75 commits into
developfrom
ji/push-frontier-all-bench

Commits on Aug 27, 2026
Commits on Aug 28, 2026
- feat(morsel): add affinity scheduler and background IO
  joseph-isaacs
  committed
  287d005
Commits on Aug 29, 2026
Commits on Sep 1, 2026
- test(morsel): compare dictionary scans through ScanBuilder
  joseph-isaacs
  committed
  4974fd1
Commits on Sep 2, 2026
- refactor(morsel): scan through a dedicated MorselScanBuilder
  
  joseph-isaacs
  and
  claude
  committed
  bcc5469
- refactor(morsel): hand I/O out of plan execution
  
  joseph-isaacs
  and
  claude
  committed
  75ed9d5
- fix(morsel): address review findings and add a primer
  
  joseph-isaacs
  and
  claude
  committed
  2b9df23
- fix(morsel): cancel scans by output lifetime and cap unfiltered limits
  
  joseph-isaacs
  and
  claude
  committed
  606de89
- fix(morsel): honour cancellation at startup and cap external outputs
  
  joseph-isaacs
  and
  claude
  committed
  c16effe
Commits on Sep 3, 2026
- refactor(morsel): extract the layout planner, node blueprint, and answerer traits
  
  joseph-isaacs
  and
  claude
  committed
  ddd6bae
- refactor(morsel): route every planning path through the planner registry
  
  joseph-isaacs
  and
  claude
  committed
  9134b75
- refactor(morsel): tighten the planner and blueprint contracts
  
  joseph-isaacs
  and
  claude
  committed
  181e561
- docs(morsel): explain the pull and push execution models side by side
  
  joseph-isaacs
  and
  claude
  committed
  07babbc
Commits on Sep 7, 2026
Commits on Sep 8, 2026
- refactor(morsel): drop the planning budget and let planning block from a cursor
  
  joseph-isaacs
  and
  claude
  committed
  0243e99
- test(morsel): trace one morsel end to end
  
  joseph-isaacs
  and
  claude
  committed
  9eaa0c3
- feat(morsel): record what every top-level plan and execute poll returned
  
  joseph-isaacs
  and
  claude
  committed
  11e7520
Commits on Sep 10, 2026
Commits on Sep 11, 2026
- feat(morsel): prune scans and support row indices
  joseph-isaacs
  committed
  442e385
- wip(morsel): checkpoint I/O follow-ups
  joseph-isaacs
  committed
  f4ca226
Commits on Sep 12, 2026
- feat(morsel): add grouped I/O frontier API
  joseph-isaacs
  committed
  714d20e
- feat(morsel): schedule bounded frontier I/O
  joseph-isaacs
  committed
  7e64ed6
- test(morsel): cover grouped frontier scheduling
  joseph-isaacs
  committed
  fa9dd59
- bench(morsel): compare push frontier I/O
  joseph-isaacs
  committed
  cb2dddb
- docs(morsel): record frontier I/O experiment
  joseph-isaacs
  committed
  08d146a
- bench(morsel): default comparisons to frontier path
  joseph-isaacs
  committed
  2022bd5
- feat: add fair push-frontier scan routing
  joseph-isaacs
  committed
  c69bd62
- feat: add exact push-frontier benchmark verification
  joseph-isaacs
  committed
  0b1eef5
- docs: record push-frontier benchmark protocol
  joseph-isaacs
  committed
  9fc6989
- fix(datafusion): leave unsupported projections above scans
  joseph-isaacs
  committed
  ade2bee
- docs: record FineWeb and TPC-DS correctness
  joseph-isaacs
  committed
  6d08d4f
- bench: separate correctness matrix policy
  joseph-isaacs
  committed
  eab26ff
- bench: gate matrix measurements on correctness
  joseph-isaacs
  committed
  10e6135
- bench: record TPC-H frontier matrix
  joseph-isaacs
  committed
  ae8c638
- bench: record ClickBench frontier matrix
  joseph-isaacs
  committed
  568fcb5
- bench: record FineWeb frontier matrix
  joseph-isaacs
  committed
  4bae722
- bench: record TPC-DS frontier matrix
  joseph-isaacs
  committed
  f102ab2
- perf: increase push frontier lookahead
  joseph-isaacs
  committed
  121a045
- revert: reject push frontier lookahead trial
  joseph-isaacs
  committed
  761ff9f
- perf: increase frontier morsel target
  joseph-isaacs
  committed
  d25daa1
- perf: reject larger frontier morsels
  joseph-isaacs
  committed
  fbb232a
- feat: publish push scan metrics
  joseph-isaacs
  committed
  f2822e7
- docs: record Q6 I/O metrics isolation
  joseph-isaacs
  committed
  7b0b268
- perf: cohort frontier predicate reads
  joseph-isaacs
  committed
  d36cd71
- revert: reject predicate frontier cohorts
  joseph-isaacs
  committed
  58e2012
- feat: add scan attribution diagnostics
  joseph-isaacs
  committed
  104297a
Commits on Sep 13, 2026
- checkpoint(io): park bounded frontier I/O work
  joseph-isaacs
  committed
  8295653
Commits on Sep 14, 2026
- checkpoint(io): document DuckDB frontier W8 performance
  joseph-isaacs
  committed
  ad0749e
Commits on Sep 15, 2026
- perf(duckdb): retain frontier prefetch and add paired SQL CI
  joseph-isaacs
  committed
  e199904
- DCO Remediation Commit for Joe Isaacs <joe.isaacs@live.co.uk>
  joseph-isaacs
  committed
  09edaaa