Skip to content

Commit 330df0e

Browse files
test(r_parity): update causal forest test and compare script
1 parent ce01563 commit 330df0e

2 files changed

Lines changed: 8 additions & 5 deletions

File tree

tests/r_parity/13_causal_forest.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -127,7 +127,9 @@ def main() -> None:
127127
"doubly-robust ATE/ATT. On this clean-overlap DGP the "
128128
"StatsPAI row uses clip=0.25, consistent with the known "
129129
"e(X) support [0.30,0.70], and agrees with grf within "
130-
"combined Monte Carlo error (worst rel gap below 0.3%). The "
130+
"combined Monte Carlo error (worst rel gap below 0.3%). A "
131+
"multi-seed clean-overlap pytest guard checks AIPW truth "
132+
"recovery for both ATE and ATT. The "
131133
"former NSW-DW stress case is now tracked in the Track B "
132134
"robustness sweep."
133135
),

tests/r_parity/compare.py

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -327,8 +327,8 @@
327327
"report the doubly-robust AIPW ATE, so the row is like-for-like and "
328328
"graded against combined sampling error rather than a fixed relative "
329329
"band. On the clean-overlap DGP the two agree within ~0.05 combined "
330-
"SE (worst rel gap below 0.3%), the AIPW recovery test certifies truth-recovery "
331-
"within 4 SE, and the B=1000 Track B row confirms calibration -- the "
330+
"SE (worst rel gap below 0.3%), the AIPW recovery tests certify truth-recovery "
331+
"within 4 SE and across multiple clean-overlap seeds, and the B=1000 Track B row confirms calibration -- the "
332332
"two criteria formerly held open are now both satisfied."
333333
),
334334
}
@@ -345,8 +345,9 @@ def _display_meta_value(module: str, key: str, value: Any) -> Any:
345345
return value.replace(
346346
"so they are like-for-like and must agree within combined Monte Carlo error",
347347
"so they agree within combined Monte Carlo error "
348-
"(worst rel gap below 0.3%, ~0.05 combined SE on the clean DGP), and the "
349-
"row is graded T3 (combined-MC-error pass)",
348+
"(worst rel gap below 0.3%, ~0.05 combined SE on the clean DGP), "
349+
"the multi-seed truth-recovery guard passes, and the row is graded T3 "
350+
"(combined-MC-error pass)",
350351
)
351352
return value
352353

0 commit comments

Comments
 (0)