inference-embedded-engine-models

Here are 3 public repositories matching this topic...

ahmedwaqas92 / gravestone

Hardware probe and best-of-N sampling harness in C. Ranks GGUF quantisations against measured VRAM and RAM, drives Ollama or llama.cpp over OpenAI-format HTTP on localhost, and gates every candidate behind a static check and a test run.

ai inference inference-server ai-agents inference-engine inference-optimization inference-acceleration inference-api ai-model ai-tools ai-agent inference-embedded-engine inference-embedded-engine-models ai-coding inference-gateway inference-providers

Updated Sep 15, 2026
C

AYUSHDHANGAR / RAG

Star

rag Inference of different rag project pipelines on google Colab

projets inference-engine googlecolab retrieval-augmented-generation inference-embedded-engine-models projets-d-infrastructure

Updated Nov 14, 2026
Jupyter Notebook

Benni-OS / benni-inference-engine

Star

GPU+CPU hybrid inference engine for the Benni OS ecosystem — MoE offload, Skill 81 Ceiling Extraction, OpenAI-compatible serve mode. Run frontier MoE models on consumer hardware.

ai models inference inference-engine inference-optimization llm llms llm-inference inference-embedded-engine-models

Updated Nov 14, 2026
Python

Add this topic to your repo

To associate your repository with the inference-embedded-engine-models topic, visit your repo's landing page and select "manage topics."

Learn more