Skip to content

fix(trainer-rank): account for recomputed mixer memory and head stages - #963

Draft
bradhilton wants to merge 52 commits into
mainfrom
dalinar/recompute-mixer-floor
Draft

fix(trainer-rank): account for recomputed mixer memory and head stages#963
bradhilton wants to merge 52 commits into
mainfrom
dalinar/recompute-mixer-floor

Run the head-stage memory tests in the Megatron lane

1763c67
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar