deterministic-eval

Here are 4 public repositories matching this topic...

yash161004 / OpenEval

Pure deterministic AI agent trajectory evaluation engine — zero judge-LLM cost, zero non-determinism, zero API latency.

python ai-agents mlops llm-evaluation llm-testing agent-evaluation deterministic-eval trajectory-scoring fixtura ci-cd-gating

Updated Jul 29, 2026
Python

A lightweight, from-scratch implementation of standard Retrieval-Augmented Generation (RAG) evaluation metrics. It computes Faithfulness, Answer Relevance, Context Recall, and Context Precision without relying on heavy external evaluation frameworks

evaluation evaluation-metrics rag deterministic-eval

Updated Sep 5, 2026
Python

Aawegg / priorityjudge

Star

Multi-pass agent that grades plans/PRDs on priority-definition quality. Line-cited evidence, deterministic citation verifier, 9887/10000 on a hand-rated calibration set.

python pytest gemini ai-agent llm-evaluation llm-as-judge openclaw deterministic-eval

Updated Jul 15, 2026
Python

contactvaibhavi / GVR-Bench

Star

Pipeline to investigate structured reasoning and instruction adherence in multimodal LLMs

benchmark robustness grounding out-of-distribution neuro-symbolic robustness-verification instruction-following trustworthy-ai large-language-models faithfulness hallucination-detection agentic-ai llm-alignment agentic-evaluation agentic-reasoning deterministic-eval

Updated May 28, 2026
Python

Add this topic to your repo

To associate your repository with the deterministic-eval topic, visit your repo's landing page and select "manage topics."

Learn more

Navigation Menu