test: literature-grounded FIPC regression/robustness suite

[seonghobae]

Scope

Add literature-grounded psychometric regression tests and APA 7th references without changing production arithmetic.

Test evidence

1. Fixed-item-parameter anchor invariance: declared anchors retain old-form a1/d values and remain fixed while unique new-form parameters remain estimable.
2. SE = TRUE information evidence: old, new, and linked models retain finite symmetric covariance matrices and a passing second-order test.
3. Planned-missing booklet robustness: structurally missing response blocks calibrate while anchor invariance is preserved.
4. Boundary-response robustness: zero-score, perfect-score, and highly skewed response patterns yield finite model outputs rather than crashing.

The prior exact head completed R CMD check successfully with these test bodies. The current head only removes the unrelated Ubuntu pin and moves the bibliography into docs/doctoring/REFERENCES.md, so #212 remains the single ABI-repair path and APA 7th evidence follows the repository doctoring convention.

Merge contract

Merge only after the new exact head passes R CMD check, repository quality/security checks, central coverage evidence, all review threads, and independent approval. No production-code behavior change is claimed.

[coderabbitai]

Warning

Review limit reached

@seonghobae, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 95 minutes

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 6565f2b3-c312-483e-9402-353122a6e44f

📥 Commits

Reviewing files that changed from the base of the PR and between 35e4498 and fb15cf4.

📒 Files selected for processing (5)

• docs/doctoring/REFERENCES.md
• tests/testthat/test-concurrent-missing-robustness.R
• tests/testthat/test-degenerate-response-robustness.R
• tests/testthat/test-kim2006-fixed-anchor-invariant.R
• tests/testthat/test-se-hessian-vcov-preservation.R

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[opencode-agent]

Pull request overview

OpenCode cannot approve yet because required coverage evidence did not pass.

Review outcome

1. HIGH .github/workflows/opencode-review.yml:1 - Coverage evidence did not prove required test/docstring evidence

• Problem: The required coverage-evidence job result was failure, so OpenCode cannot establish approval sufficiency for this head.

• Root cause: Automated approval is only valid when the same-head coverage-evidence job proves supported repository test suites passed and configured docstring gates passed or were advisory, or reports not applicable because no supported source files or package manifests exist. Missing, failed, skipped, unavailable, or unsupported-tooling test evidence is a blocker.

• Fix: Install or configure the repository test/docstring evidence tooling when source files or package manifests exist, rerun the current-head coverage-evidence job, and approve only after it reports success with required evidence or explicit no-source not-applicable evidence.

• Regression test: Keep the approval branch checking needs.coverage-evidence.result == success before posting APPROVE, and publish REQUEST_CHANGES when coverage-evidence blocker states such as cancelled, skipped, failed, unsupported-tooling, or below-100 evidence are present.

• Result: REQUEST_CHANGES

• Reason: coverage-evidence result was failure, so required test/docstring evidence was not proven for current head 8b122e01bcdb1f990fac84b39e543e459545bdf4.

• Head SHA: 8b122e01bcdb1f990fac84b39e543e459545bdf4

• Workflow run: 30497395945

• Workflow attempt: 1

Coverage evidence

Coverage Decision

• Result: FAIL
• Test evidence: not proven passing
• Docstring evidence: not proven passing when configured
• Failure count: 1

Changed-File Evidence Map

flowchart LR
  PR["PR changed files"] --> Evidence["OpenCode bounded evidence"]
  Evidence --> S1["Docs: references.md"]
  S1 --> I1["operator or user guidance"]
  I1 --> R1["Review risk: Docs: references.md"]
  R1 --> V1["docs review"]
  Evidence --> S2["Test (4 files)"]
  S2 --> I2["regression suite"]
  I2 --> R2["Review risk: Test (4 files)"]
  R2 --> V2["targeted test run"]

Loading

[opencode-agent]

OpenCode Review Overview

• Head SHA: fb15cf47fa9bd1c6887a1fec070bf6046317e243
• Workflow run: 31839905805
• Workflow attempt: 1
• Gate result: REQUEST_CHANGES (approval step)

Pull request overview

OpenCode cannot approve yet because required coverage evidence did not pass.

Review outcome

1. HIGH .github/workflows/opencode-review.yml:1 - Coverage evidence did not prove required test/docstring evidence

• Problem: The required coverage-evidence job result was failure, so OpenCode cannot establish approval sufficiency for this head.

• Root cause: Automated approval is only valid when the same-head coverage-evidence job proves supported repository test suites passed and configured docstring gates passed or were advisory, or reports not applicable because no supported source files or package manifests exist. Missing, failed, skipped, unavailable, or unsupported-tooling test evidence is a blocker.

• Fix: Install or configure the repository test/docstring evidence tooling when source files or package manifests exist, rerun the current-head coverage-evidence job, and approve only after it reports success with required evidence or explicit no-source not-applicable evidence.

• Regression test: Keep the approval branch checking needs.coverage-evidence.result == success before posting APPROVE, and publish REQUEST_CHANGES when coverage-evidence blocker states such as cancelled, skipped, failed, unsupported-tooling, or below-100 evidence are present.

• Result: REQUEST_CHANGES

• Reason: coverage-evidence result was failure, so required test/docstring evidence was not proven for current head fb15cf47fa9bd1c6887a1fec070bf6046317e243.

• Head SHA: fb15cf47fa9bd1c6887a1fec070bf6046317e243

• Workflow run: 31839905805

• Workflow attempt: 1

Coverage evidence

Coverage Decision

• Result: FAIL
• Test evidence: not proven passing
• Docstring evidence: not proven passing when configured
• Failure count: 1

Changed-File Evidence Map

flowchart LR
  PR["PR changed files"] --> Evidence["OpenCode bounded evidence"]
  Evidence --> S1["Docs: REFERENCES.md"]
  S1 --> I1["operator or user guidance"]
  I1 --> R1["Review risk: Docs: REFERENCES.md"]
  R1 --> V1["docs review"]
  Evidence --> S2["Test (4 files)"]
  S2 --> I2["regression suite"]
  I2 --> R2["Review risk: Test (4 files)"]
  R2 --> V2["targeted test run"]

Loading

[seonghobae]

CI diagnosis: check (r.yml) failure is a pre-existing dependency-build blocker, not this PR

The failing check job (run 30497154625, job 90728517735) did not fail in R CMD check or in any test in this PR — it failed earlier, in the "Set up R package dependencies" step (r-lib/actions/setup-r-dependencies, action step __run_6), while byte-compiling SimDesign 2.26 (a transitive dependency of mirt). The tests in this PR never executed.

Exact error from the step log:

ℹ Building SimDesign 2.26
✖ Failed to build SimDesign 2.26 (1.4s)
** byte-compile and prepare package for lazy loading
Error in dyn.load(file, DLLpath = DLLpath, ...) :
  unable to load shared object '/home/runner/work/_temp/Library/stringfish/libs/stringfish.so':
  /home/runner/work/_temp/Library/stringfish/libs/stringfish.so: undefined symbol:
  _ZN3tbb8internal25concurrent_vector_base_v316internal_grow_byEmmPFvPvPKvmES4_
ERROR: lazy loading failed for package 'SimDesign'
##[error]Process completed with exit code 1.

Root cause

An Intel TBB ABI/linkage skew in the restored dependency cache: the cached stringfish.so (pulled in via SimDesign → qs → stringfish) was built against an older RcppParallel/TBB, but this run freshly built RcppParallel 6.1.1 (which vendors TBB). The demangled missing symbol is tbb::internal::concurrent_vector_base_v3::internal_grow_by(...), so stringfish.so references a TBB symbol absent in the current build → dyn.load fails → SimDesign lazy-load fails → the whole dependency install aborts before R CMD check runs.

Why this is not caused by this PR

• This PR adds only testthat .R files and one Markdown doc (docs/references.md); it changes no C/C++ code and cannot affect a dependency's compiled ABI.
• Every recent r.yml run fails at the same stage, on unrelated branches (e.g. the bolt-optim-* and sentinel-* PRs, back to 2026-07-28) — this is a systemic CI-environment failure, not a regression from test: literature-grounded FIPC regression/robustness suite #189.
• I could not reproduce/verify locally: this sandbox's egress policy blocks all CRAN/Posit mirrors (403 on CONNECT), so mirt and its dependency tree cannot be installed here.

Recommended remediation (needs a maintainer with repo/Actions access)

1. Invalidate the setup-r-dependencies cache so stringfish/qs rebuild from source against RcppParallel 6.1.1 — bump the cache-version input on the setup-r-dependencies step, or delete the repo's Actions caches. A plain re-run alone will likely restore the same broken stringfish.so and fail identically.
2. If it persists after cache invalidation, pin compatible RcppParallel/stringfish/qs versions (or install system libtbb on the runner) until upstream binaries realign.

No test in this PR should be changed to work around this — the suite is correct and will run once the runner's dependency toolchain builds mirt again.

---

Generated by Claude Code

[opencode-agent]

Pull request overview

OpenCode cannot approve yet because required coverage evidence did not pass.

Review outcome

1. HIGH .github/workflows/opencode-review.yml:1 - Coverage evidence did not prove required test/docstring evidence

• Problem: The required coverage-evidence job result was failure, so OpenCode cannot establish approval sufficiency for this head.

• Root cause: Automated approval is only valid when the same-head coverage-evidence job proves supported repository test suites passed and configured docstring gates passed or were advisory, or reports not applicable because no supported source files or package manifests exist. Missing, failed, skipped, unavailable, or unsupported-tooling test evidence is a blocker.

• Fix: Install or configure the repository test/docstring evidence tooling when source files or package manifests exist, rerun the current-head coverage-evidence job, and approve only after it reports success with required evidence or explicit no-source not-applicable evidence.

• Regression test: Keep the approval branch checking needs.coverage-evidence.result == success before posting APPROVE, and publish REQUEST_CHANGES when coverage-evidence blocker states such as cancelled, skipped, failed, unsupported-tooling, or below-100 evidence are present.

• Result: REQUEST_CHANGES

• Reason: coverage-evidence result was failure, so required test/docstring evidence was not proven for current head d53a877164151c81b42272072ae294336849769a.

• Head SHA: d53a877164151c81b42272072ae294336849769a

• Workflow run: 30505299347

• Workflow attempt: 1

Coverage evidence

Coverage Decision

• Result: FAIL
• Test evidence: not proven passing
• Docstring evidence: not proven passing when configured
• Failure count: 1

Changed-File Evidence Map

flowchart LR
  PR["PR changed files"] --> Evidence["OpenCode bounded evidence"]
  Evidence --> S1["Workflow: r.yml"]
  S1 --> I1["GitHub Actions review job"]
  I1 --> R1["Review risk: Workflow: r.yml"]
  R1 --> V1["actionlint plus required checks"]
  Evidence --> S2["Docs: references.md"]
  S2 --> I2["operator or user guidance"]
  I2 --> R2["Review risk: Docs: references.md"]
  R2 --> V2["docs review"]
  Evidence --> S3["Test (4 files)"]
  S3 --> I3["regression suite"]
  I3 --> R3["Review risk: Test (4 files)"]
  R3 --> V3["targeted test run"]

Loading

[seonghobae]

The REQUEST_CHANGES is a central sandbox limitation, not a defect in this PR

The OpenCode gate reports coverage-evidence = FAIL for head d53a877 (dispatch run 30505299347, in ContextualWisdomLab/.github). That failure is not reproducible in this repository's own required checks, and the PR's tests are green:

• This PR's required check job (R CMD check, pinned to ubuntu-22.04) passes. On jammy, P3M ships precompiled binaries, so mirt → SimDesign → qs → stringfish install and load, and the full suite — including the four new tests (test-kim2006-fixed-anchor-invariant, test-se-hessian-vcov-preservation, test-concurrent-missing-robustness, test-degenerate-response-robustness) — runs against real mirt and passes.
• The head's own coverage-evidence check is also green.

Root cause (in the central review sandbox, not here)

The dispatch's R path in .github/workflows/opencode-review-dispatch.yml (run_r_test_coverage, ~L1339–1347) installs distribution packages only — r-base + covr + testthat + libcurl/libssl/libxml2-dev — and then runs testthat::test_dir("tests/testthat") without installing the package-under-test's Imports (mirt). Verbatim from run 30505299347:

[ FAIL 7 | WARN 0 | SKIP 8 | PASS 6 ]
test-surveyFA.R:47:3 ... base::loadNamespace(x)
/usr/lib/R/bin/config: 1: eval: make: not found

aFIPC hard-Imports mirt, so any test that touches aFIPC:: loads its namespace → loadNamespace("mirt") → no package mirt in the distribution-only library → the expected validation/expect_error message never fires and the assertion fails. The 8 skips are the skip_if_not_installed("mirt") tests; the 7 failures are the ones that call aFIPC:: without that guard. This is an environment gap, not a test defect, and it affects every R package with compiled Imports (aFIPC, kaefa, nonnest2), so OpenCode can never reach APPROVE for them.

Suggested central fix (maintainer-side)

That same block already defers to the required peer R CMD check evidence when testthat itself is unavailable (L1347). Extend that: when testthat::test_dir cannot load the package's Imports/namespace (a loadNamespace/there is no package called condition, distinct from a real assertion failure), defer to the peer check job rather than counting it as a coverage failure. Deferring is safe — the peer R CMD check is a required gate that installs dependencies and runs the full suite, so a genuine R test failure still blocks the merge.

I'm flagging rather than patching because the fix lives in the contract-test-guarded central review workflow, which I can neither exercise against the live dispatch nor merge from here. No change is needed on this branch.

---

Generated by Claude Code

[opencode-agent]

Pull request overview

OpenCode cannot approve yet because required coverage evidence did not pass.

Review outcome

1. HIGH .github/workflows/opencode-review.yml:1 - Coverage evidence did not prove required test/docstring evidence

• Problem: The required coverage-evidence job result was failure, so OpenCode cannot establish approval sufficiency for this head.

• Root cause: Automated approval is only valid when the same-head coverage-evidence job proves supported repository test suites passed and configured docstring gates passed or were advisory, or reports not applicable because no supported source files or package manifests exist. Missing, failed, skipped, unavailable, or unsupported-tooling test evidence is a blocker.

• Fix: Install or configure the repository test/docstring evidence tooling when source files or package manifests exist, rerun the current-head coverage-evidence job, and approve only after it reports success with required evidence or explicit no-source not-applicable evidence.

• Regression test: Keep the approval branch checking needs.coverage-evidence.result == success before posting APPROVE, and publish REQUEST_CHANGES when coverage-evidence blocker states such as cancelled, skipped, failed, unsupported-tooling, or below-100 evidence are present.

• Result: REQUEST_CHANGES

• Reason: coverage-evidence result was failure, so required test/docstring evidence was not proven for current head 9e59aaae13bee172dd51deb65d3cc0ea9fbbb36c.

• Head SHA: 9e59aaae13bee172dd51deb65d3cc0ea9fbbb36c

• Workflow run: 30833287603

• Workflow attempt: 1

Coverage evidence

Coverage Decision

• Result: FAIL
• Test evidence: not proven passing
• Docstring evidence: not proven passing when configured
• Failure count: 1

Changed-File Evidence Map

flowchart LR
  PR["PR changed files"] --> Evidence["OpenCode bounded evidence"]
  Evidence --> S1["Workflow: r.yml"]
  S1 --> I1["GitHub Actions review job"]
  I1 --> R1["Review risk: Workflow: r.yml"]
  R1 --> V1["actionlint plus required checks"]
  Evidence --> S2["Docs: references.md"]
  S2 --> I2["operator or user guidance"]
  I2 --> R2["Review risk: Docs: references.md"]
  R2 --> V2["docs review"]
  Evidence --> S3["Test (4 files)"]
  S3 --> I3["regression suite"]
  I3 --> R3["Review risk: Test (4 files)"]
  R3 --> V3["targeted test run"]

Loading

[opencode-agent]

Pull request overview

OpenCode cannot approve yet because required coverage evidence did not pass.

Review outcome

1. HIGH .github/workflows/opencode-review.yml:1 - Coverage evidence did not prove required test/docstring evidence

• Problem: The required coverage-evidence job result was failure, so OpenCode cannot establish approval sufficiency for this head.

• Root cause: Automated approval is only valid when the same-head coverage-evidence job proves supported repository test suites passed and configured docstring gates passed or were advisory, or reports not applicable because no supported source files or package manifests exist. Missing, failed, skipped, unavailable, or unsupported-tooling test evidence is a blocker.

• Fix: Install or configure the repository test/docstring evidence tooling when source files or package manifests exist, rerun the current-head coverage-evidence job, and approve only after it reports success with required evidence or explicit no-source not-applicable evidence.

• Regression test: Keep the approval branch checking needs.coverage-evidence.result == success before posting APPROVE, and publish REQUEST_CHANGES when coverage-evidence blocker states such as cancelled, skipped, failed, unsupported-tooling, or below-100 evidence are present.

• Result: REQUEST_CHANGES

• Reason: coverage-evidence result was failure, so required test/docstring evidence was not proven for current head fb15cf47fa9bd1c6887a1fec070bf6046317e243.

• Head SHA: fb15cf47fa9bd1c6887a1fec070bf6046317e243

• Workflow run: 31839905805

• Workflow attempt: 1

Coverage evidence

Coverage Decision

• Result: FAIL
• Test evidence: not proven passing
• Docstring evidence: not proven passing when configured
• Failure count: 1

Changed-File Evidence Map

flowchart LR
  PR["PR changed files"] --> Evidence["OpenCode bounded evidence"]
  Evidence --> S1["Docs: REFERENCES.md"]
  S1 --> I1["operator or user guidance"]
  I1 --> R1["Review risk: Docs: REFERENCES.md"]
  R1 --> V1["docs review"]
  Evidence --> S2["Test (4 files)"]
  S2 --> I2["regression suite"]
  I2 --> R2["Review risk: Test (4 files)"]
  R2 --> V2["targeted test run"]

Loading