Skip to content

CI: Speed up the Tests workflow by restoring baseline images from the dvc-cache artifact - #9258

Merged
Esteban82 merged 1 commit into
masterfrom
ci-dvc-cache-first
Oct 12, 2026
Merged

Esteban82 merged 1 commit into
masterfrom
ci-dvc-cache-first

Conversation

@Esteban82

Copy link
Copy Markdown
Member

Speeds up the Tests workflow by about 20-55 min per OS. Each job (Linux, macOS, Windows) spent ~30 min downloading ~1200 baseline images from DagsHub with dvc pull, and the three jobs did it in parallel. This change first downloads the dvc-cache artifact that ci-caches.yml already builds (one 85 MB zip, ~10 s) and then runs dvc pull, which now only fetches what the artifact lacks (e.g. baselines added by the PR). With nothing missing it does not contact DagsHub at all. If DagsHub fails, dvc checkout --force keeps the old fallback behavior.

master (run 38098393012) this branch (run 38196501375)
Linux baseline step 29 min, job 49 min 12 s, job 28 min
Windows baseline step 30 min, job 46 min 22 s, job 17 min
macOS baseline step 32 min, job 147 min 20 s, job 91 min

All 1122 baseline files were restored on every OS, and the test failures are the same as on master.

🤖 Generated with Claude Code (Claude Opus 5.5)

… from DagsHub

Each Tests job ran a full `dvc pull` from DagsHub (~1200 objects, 30-40
min per OS). The dvc-cache artifact that ci-caches.yml already uploads
holds the same objects in one 85 MB zip, so download it first and let
`dvc pull` fetch only what it lacks (e.g. baselines added by the PR).
With nothing missing, `dvc pull` does not contact the remote. If
DagsHub fails, `dvc checkout --force` restores what the cache has, as
the old fallback step did.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@Esteban82
Esteban82 requested a review from seisman October 12, 2026 14:10
@Esteban82 Esteban82 added the maintenance Boring but important stuff for the core devs label Oct 12, 2026
@Esteban82
Esteban82 requested a review from joa-quim October 12, 2026 16:42

@joa-quim joa-quim left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds very good

@Esteban82
Esteban82 merged commit 4e24504 into master Oct 12, 2026
16 of 22 checks passed
@Esteban82
Esteban82 deleted the ci-dvc-cache-first branch October 12, 2026 20:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

maintenance Boring but important stuff for the core devs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants