Popular repositories Loading
-
tensorfold-qwen38-exl3-lookup
tensorfold-qwen38-exl3-lookup PublicQwen3.8-Flash-Next EXL3 3.05bpw on ONE DGX Spark (GB10): ~2.4x prefill (700->1777 t/s), prompt-lookup drafter, native vision/video, 262k ctx. Unofficial TensorFold v0.6.5 fork, 18 patches, byte-exa…
Python 9
-
-
freetoken-tp2-nvfp4
freetoken-tp2-nvfp4 PublicFreeToken TP=2 across heterogeneous consumer CUDA GPUs (Ampere+Ada, no native FP4): NVFP4 quantized-MoE expert sharding, bit-exact vs single-GPU greedy. Port of issue #478 methodology.
Python
-
TensorFold
TensorFold PublicForked from ashhart/TensorFold
LLM Inference Engine for Metal, CUDA and Vulkan.
Python
-
hippocampus
hippocampus PublicHippocampus - an external memory organ for LLMs: self-hosted memory base that outlives the session and the model.
Python
If the problem persists, check the GitHub status page or contact support.