Skip to content

feat(dynamo): alias multi-token KV cache writes so multi-profile works with static cache - #4749

Open
cehongwang wants to merge 2 commits into
mainfrom
cehongw/static-cache-enablement
Open

feat(dynamo): alias multi-token KV cache writes so multi-profile works with static cache#4749
cehongwang wants to merge 2 commits into
mainfrom
cehongw/static-cache-enablement

fix(dynamo): accept a [1]-shaped cache-position offset in the KV writ…

8f44093
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar