Skip to content

fix: stop activation KV cache from growing every turn - #2359

Closed
yetuge wants to merge 13 commits into
MemTensor:mainfrom
yetuge:fix/activation-cache-aliasing
Closed

fix: stop activation KV cache from growing every turn#2359
yetuge wants to merge 13 commits into
MemTensor:mainfrom
yetuge:fix/activation-cache-aliasing

fix: reset destination cache layers

3fca5d6
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar