Skip to content

ggml: MUL_MAT_ID has a backward pass through frozen experts, so a LoRA trains on a MoE base (GGML_OP_MUL_MAT_ID_BACK; continuum card 14b64aa9) - #82

Merged
joelteply merged 3 commits into
889580fc/seq-state-across-stream-countsfrom
cormac/mul-mat-id-backward
Oct 31, 2026
Merged

ggml: MUL_MAT_ID has a backward pass through frozen experts, so a LoRA trains on a MoE base (GGML_OP_MUL_MAT_ID_BACK; continuum card 14b64aa9)#82
joelteply merged 3 commits into
889580fc/seq-state-across-stream-countsfrom
cormac/mul-mat-id-backward

ggml-rpc: GGML_OP_COUNT is 103 with MUL_MAT_ID_BACK, so the RPC proto…

3a82e31
Select commit
Loading
Failed to load commit list.
WIP / WIP succeeded Oct 31, 2026 in 1s

Ready for review

No match found based on configuration

Details

By default, WIP only checks the pull request title for the terms "WIP", "Work in progress" and "🚧".

You can configure both the terms and the location that the WIP app will look for by signing up for the pro plan: https://github.com/marketplace/wip. All revenue will be donated to Processing | p5.js – one of the most diverse and impactful Open Source community there is.

View more details on WIP