Skip to content

[None][perf] One-model speculative decoding: host work between steps, worker-produced target logits, KDA drafts' records - #19989

Open
vsabavat wants to merge 106 commits into
NVIDIA:mainfrom
vsabavat:k3-cons/b-runtime
Open

vsabavat wants to merge 106 commits into
NVIDIA:mainfrom
vsabavat:k3-cons/b-runtime

[None][chore] Merge current main c226e2d77c into the K3 runtime branch

cb9aa92
Select commit
Loading
Failed to load commit list.