Turnkey speculative decoding matrix evaluator and EAGLE draft head trainer for local LLMs
machine-learning transformers pytorch developer-tools fastapi inference-acceleration typer-cli model-distillation llm-inference speculative-decoding ai-performance tree-attention eagle-draft-head acceptance-rate-profiling matrix-evaluator
-
Updated
Oct 13, 2026 - Python