Skip to content

fix(cuda-graph): keep replay metadata dynamic across tensor-parallel ranks - #540

Open
junjiewang253-ctrl wants to merge 3 commits into
InfiniTensor:mainfrom
junjiewang253-ctrl:fix/cuda-graph-static-kv-replay
Open

fix(cuda-graph): keep replay metadata dynamic across tensor-parallel ranks#540
junjiewang253-ctrl wants to merge 3 commits into
InfiniTensor:mainfrom
junjiewang253-ctrl:fix/cuda-graph-static-kv-replay

style: format static graph metadata test

293db2a
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs