Skip to content

test(conformance): add golden artifact corpus - #403

Merged
szmyty merged 1 commit into
mainfrom
test/golden-conformance-corpus-366
Sep 12, 2026
Merged

szmyty merged 1 commit into
mainfrom
test/golden-conformance-corpus-366

Conversation

@szmyty

@szmyty szmyty commented Sep 12, 2026

Copy link
Copy Markdown
Contributor

Closes #366

Summary

  • add a versioned CC0 synthetic corpus spanning document, paged document, raster/vector image, audio, video, archive, structured data, subtitle, corrupt, extension/magic mismatch, unknown binary, and ordered collection cases
  • add a hermetic production-path harness covering deterministic planning/execution, shared intermediates, cross-family output, aggregation, cache behavior, provider fallback, validation and branch-local failures, cancellation, checkpoint resume/invalidation, hygiene gates, bounded extraction, bundled profiles, and Flow artifact projection
  • add Draft 2020-12 schemas for the corpus and machine-readable conformance report, and map covered formats into the existing capability matrix
  • disambiguate RIFF and ISO base media detection by form/major brand so valid WAVE and MP4 fixtures do not produce false conflicts
  • add documented fast/tool-backed/maximal tiers plus scheduled and release report publication

Focused checks

  • changed-file rustfmt --check
  • cargo check --workspace --all-features --locked
  • focused Clippy with warnings denied
  • golden conformance harness in fast and maximal report modes
  • focused detector tests (32 passed)
  • focused capability-matrix test
  • Draft 2020-12 validation of both the corpus and emitted report schemas
  • conformance workflow YAML parse and git diff --check

The full test suite and GitHub Actions were intentionally deferred for this speed-run.

@szmyty
szmyty merged commit da9e477 into main Sep 12, 2026
14 of 17 checks passed
@szmyty
szmyty deleted the test/golden-conformance-corpus-366 branch September 12, 2026 02:43
@devactivity-app

Copy link
Copy Markdown

Pull Request Summary by devActivity

Metrics

Cycle Time: 1m Coding Time: < 1 min

Achievements

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Establish a golden artifact corpus and end-to-end artifact-forest conformance suite

1 participant