Skip to content

Fix zero-fixture false-pass gate#38

Merged
yangfei222666-9 merged 1 commit into
mainfrom
agent-reliability-zero-fixture-fix-v2
Jun 24, 2026
Merged

Fix zero-fixture false-pass gate#38
yangfei222666-9 merged 1 commit into
mainfrom
agent-reliability-zero-fixture-fix-v2

Conversation

@yangfei222666-9

Copy link
Copy Markdown
Owner

Summary

  • Reject missing fixture directories in the False-Pass Gate self-test.
  • Reject empty fixture directories so self_test cannot pass with cases=0.
  • Narrow public wording to schema-level evidence-pointer and cannot_claim boundaries.

Verification

  • python3 scripts/check_false_pass_gate.py --self-test examples/false_pass_gate/fixtures
  • uv run --no-project --with pytest python -m pytest tests/test_false_pass_gate.py -q
  • python3 -m json.tool docs/proof_index.json
  • npm run typecheck
  • negative empty fixture directory exits 1 with reason=no_fixtures
  • negative missing fixture directory exits 1 with reason=fixtures_dir_not_found

Boundaries

  • Draft PR only.
  • Not ready for review.
  • Not merged.
  • Provider output is not truth.
  • This gate does not prove agent claims are true; it blocks success language when passing evidence pointers or explicit cannot_claim boundaries are missing.

@yangfei222666-9 yangfei222666-9 marked this pull request as ready for review June 24, 2026 14:26
@yangfei222666-9 yangfei222666-9 merged commit de1907f into main Jun 24, 2026
8 checks passed
@yangfei222666-9 yangfei222666-9 deleted the agent-reliability-zero-fixture-fix-v2 branch June 24, 2026 14:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant