test-oracle

Beet is a Daikon front-end and one of the core components of AGORA (Automated Generation of test Oracles for REST APIs), the first approach for the automated generation of test oracles for REST APIs in a black-box context.

Your coding agent says "done". Orvant asks for proof. A skill for Claude Code, Codex and other file-capable agents, plus a Python engine that clarifies the goal, prepares an independent acceptance oracle and accepts work only through an independent gate. Engine workers currently run on Codex CLI. Open beta.

ResearchLoop V4：双 Loop 多智能体科研/工程协作工作流，把模糊目标冻结成 Spec，并用 Test Oracle、Worktree Check 与三道人类门实现可审计交付。

AgentLoop — harness-agnostic, self-verifying autonomy wrapper for coding agents. Drives OpenCode/Kilo/Claude/Aider/Codex in a verify-gated loop with a held-out oracle, so the agent actually finishes and proves it is correct.

Fuzz3 is a fuzzer using entropy as a third oracle

PostmanAssertify is a tool for the automated generation of test assertions for REST API testing. PostmanAssertify is a complementary component of AGORA+, the first approach for the automated generation of test oracles for REST APIs in a black-box context.

LLM査読の検出力をラベル付き見本で採点するメタ評価ハーネス | Meta-eval: grading an LLM reviewer with labeled specimens

答えが一意でない出力を仕様アサーションで採点するEDD実証 | Divisor finder graded by a spec-assertion oracle

非決定的なシャッフルをカイ二乗検定で採点する統計オラクル | Shuffle graded by Monte-Carlo statistical tests

Fractal design docs: one frame, zoom into any element, same shape at every depth — with a document-structure oracle | 枠1枚から掘れるフラクタル設計書の生成エージェント＋文書構造オラクル

Oráculos metamórficos para teste E2E de navegador — estudo em quatro camadas: teoria, catálogo de 24 relações, mercado e especificação de stack em AWS (pt-BR)

正解表なしで5つの性質からソートを採点するメタモルフィック・オラクル | Sort graded by metamorphic relations

ランダム入力の集中砲火で「壊れない」を採点するファジング・オラクル | Robust parser graded by a fuzzing (implicit) oracle

The reusable half of a production mobile automation suite: Page Object base class, Appium session management, a page-object generator that reads a live screen, and backend API oracles so a green screen is not the only evidence.

Claude Codeエージェント定義の査読と、その検出力を採点するオラクル | Agent-spec review graded by a detection-power oracle

要約をLLM採点＋決定的ゲートで合否判定するEDD実証 | Summaries graded by LLM-as-judge + a deterministic gate

Research artifact on the oracle problem for quantum software testing

Requirements-to-PR pipeline with a frozen test oracle, a fail-closed draft gate, and a CI self-test proving it fires.

日本語→SQLをSQLite実行結果で採点する実行オラクルのEDD実証 | Text-to-SQL graded by an execution oracle

decode(encode(x))==x の往復プロパティで採点するEDD実証 | RLE codec graded by a round-trip property oracle