Skip to content

The engine reports its cells: llama_memory_cell_usage, GET /cells, POST /v1/chat/completions/cells - #92

Merged
joelteply merged 3 commits into
889580fc/seq-state-across-stream-countsfrom
fable/cell-usage
Nov 4, 2026
Merged

joelteply merged 3 commits into
889580fc/seq-state-across-stream-countsfrom
fable/cell-usage

Cells report per stream, and a cached prefix is clamped to what the s…

bd43e2a
Select commit
Loading
Failed to load commit list.