Skip to content

feat(attention): cuDNN FROST attention backend for head_dim in (256, 512], with context parallelism - #3527

Open
nvegesna-netizen wants to merge 101 commits into
NVIDIA:mainfrom
nvegesna-netizen:nvegesna/te-frost-d512-cp
Open

nvegesna-netizen wants to merge 101 commits into
NVIDIA:mainfrom
nvegesna-netizen:nvegesna/te-frost-d512-cp

docs(attention): shorten the cudnn_pygraph module docstring

0effc6c
Select commit
Loading
Failed to load commit list.