skip-layers

Here is 1 public repository matching this topic...

Bash scripts to skip transformer layers at model load time, reducing VRAM usage with minim

bash cuda llama-cpp llm-inference moe-models vram-optimization transformer-blocks skip-layers

To associate your repository with the skip-layers topic, visit your repo's landing page and select "manage topics."