PDSchedule is an on-demand scheduling framework for disaggregated LLM inference across WANs, improving SLO attainment and system efficiency.
llm vllm llm-inference kvcache distributed-inference nixl lmcache llm-task-scheduling slo-aware-scheduling prefill-decode-disaggregation network-aware-scheduling
-
Updated
Nov 3, 2026 - Python