Skip to content
View camerontjs-dot's full-sized avatar
  • Toronto
  • 15:42 (UTC -04:00)

Block or report camerontjs-dot

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
camerontjs-dot/README.md

Cameron Sanderson

I build and evaluate AI systems around evidence, retrieval, agent behavior, and decisions under uncertainty.

My background is more than eight years in sterile pharmaceutical laboratory and quality work (cGMP, USP 797). The same habits carry into software: preserve source state, make failure modes testable, and leave enough evidence for someone else to challenge the result.

Based in Ontario, Canada. Bilingual English and French.

Start here

Claim support apparatus

  1. Claim Audit Lab audits whether draft claims are supported by supplied evidence. Its current default path retrieves candidate passages, gets an NLI entailment signal, then applies a frozen deterministic rule set. Reports preserve the engine, rules identity, decision trace, and explicit limits.
  2. Evidence Bundler prepares traceable evidence bundles from bounded corpora. Retrieval nominates candidate passages; review and finalization decide what enters the downstream bundle.
  3. Apparatus Contracts owns the versioned, integrity-checked handoff contracts between the evidence and audit stages.

Agent evaluation and completion honesty

  1. agent-eval-notes contains public-safe methods and measurement notes from a private sealed evaluation lab, including harness comparisons, multi-file coding screens, task-family transfer, RAG routes, and verifier-tool experiments.
  2. verified-done is the runnable public companion. It separates verified pass, false completion, and scope violation, and its selftest checks that every deterministic verifier rejects the starting state and accepts the reference solution.

Selected measurements

  • On a sealed 36-run coding-agent suite, a structured packet harness moved verified passes from 28/36 to 34/36 and scope violations from 6 to 0. It was still not promoted because a predeclared gate caught 2 false completion claims on multi-file work.
  • In the public run_verify ablation, verifier access changed false-completion behavior for Haiku on the two-file task (3/3 false completion without the tool, 0/3 with it) and for qwen2.5-coder:14b across two Ollama versions (20/20 without, 1/20 with). qwen3:14b still produced 9/10 false completions with the tool, so the effect is model-dependent rather than a universal fix.

These are exploratory measurements with stated sample sizes, not production validation.

Workspace and retrieval

  • MainFrame is the public cut of my lifecycle-first Markdown workspace. It separates inbox, ingest, durable knowledge, live state, projects, and archive, with deterministic scripts around the file tree. Private corpora and live personal state stay out of the public repository.
  • MindGraph is the standalone local retrieval engine used around that workspace: BM25, sqlite-vec semantic retrieval, reciprocal-rank fusion, and typed Markdown link traversal in one SQLite-backed service-free package.

Other public work

  • Grounded Agent Lab is a small research agent that answers from cited fixture notes or abstains. It keeps retrieval routes labelled, exposes only read-only tools, fails closed when optional providers are unavailable, and ships a rerunnable demo plus explicit limitations.
  • Career Decision Engine is a browser decision-support tool that keeps weighted scores, rule checks, confidence labels, assumptions, and cannot-verify items visible. Live demo.

Boundaries

Claim Audit Lab audits support relative to supplied evidence; it does not establish truth about the world. Evidence Bundler nominates and prepares evidence; retrieval scores are not support verdicts. The agent-evaluation numbers above are exploratory measurements, and the sealed fixtures behind the private-suite headline are not published. MainFrame's public repository excludes private corpora and volatile personal state.

What I am looking for

Work where AI systems meet review, reliability, and real operating constraints:

  • AI evaluation, agent reliability, and evidence-handling workflows
  • regulated software, quality systems, and data integrity
  • forward-deployed or consulting work that maps a real process before automation

Contact

Pinned Loading

  1. evidence-bundler evidence-bundler Public

    Traceable evidence-bundle preparation for research corpora, with retrieval nominations, review sidecars, provenance, and adapter-ready outputs. It is a RAG-adjacent evidence-preparation pipeline: r…

    Python 1

  2. basic-research-harness basic-research-harness Public

    A small agent-engineering harness that turns a research topic into an inspectable JSON bundle with source-to-claim provenance. Built two ways: a raw Python agent loop and a Claude Code SDK rebuild …

    Python

  3. apparatus-contracts apparatus-contracts Public

    Canonical handoff contracts and a hash-verified verifier suite for the research scaffold evaluation apparatus. Regulated-industry data-integrity grammar (ALCOA+, 21 CFR Part 11) applied to AI workf…

    Python 1

  4. MindGraph MindGraph Public

    Local, graph-augmented retrieval engine for personal Markdown knowledge bases. One SQLite file, no service. Fuses BM25 + sqlite-vec with RRF and walks a typed [[link]] graph.

    Python