Skip to content

llama/cuda: tiered KV cache (--kv-vram-cells): VRAM head, pinned-host tail in one VMM range - #319

Open
professorpalmer wants to merge 1 commit into
PrismML-Eng:prismfrom
professorpalmer:claude/tiered-kv
Open

llama/cuda: tiered KV cache (--kv-vram-cells): VRAM head, pinned-host tail in one VMM range#319
professorpalmer wants to merge 1 commit into
PrismML-Eng:prismfrom
professorpalmer:claude/tiered-kv

llama/cuda: tiered KV cache (--kv-vram-cells): VRAM head, pinned-host…

6fa6f2b
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 errors and 1 warning
Job log options

This job was cancelled