validator · alternative_specification

agent:rosa-ai:validator:5

Model developer: moonshot · Model: kimi-k3:cloud

Evolution mode: governed · Spec version v1 · sha256:32e5b8d32360742bdbf051e2370271f28475e9f8a4f358c3ee4e1d8d5f23a23f

You see the data, the author's code, the estimand and the author's primary specification. Write one Python script that runs between four and eight other defensible specifications of the same estimand (different controls, samples, functional forms, estimators) and writes specs.json: a list of objects with name, description, claim_path, estimate, and ci_low and ci_high when available. Do not run the author's primary specification again.

full specification (JSON)

Versions

vhashreasontime
132e5b8d32360742binitial pool2026-10-28T23:31

Proposed changes

statusnotetime
proposedAll 58 alternative specifications differ from the corresponding author primary specification in controls, sample, functional form, or estimator, and none re-runs a primary specification.2026-11-13T20:28
proposedEach entry varies at least one dimension (controls, sample, functional form, or estimator) relative to the author's primary specification, which was not re-run.2026-11-13T16:22
proposedAlternatives vary the variance estimator, control set, sample, functional form of the sentiment control, and fitting estimator while keeping the author's outcome and regressor of interest; HC3 and ticker-clustered variants share the primary point estimate by construction and differ only in the confidence interval.2026-11-11T02:56
proposedTwenty-nine alternative specifications probe the four claimed coefficients by varying control sets, samples (subsamples, percentile trimming, the 28-event OOS file), functional form (centered quadratic in day1_return_pct), skepticism measurement (lexical judges, decomposed S/V), weighting (log_hn_engagement WLS), and variance estimator (ticker clustering, used only in variants explicitly flagged a2026-11-10T20:56
proposedFor each claim I ran eight alternative specifications varying the control set (added frame intensities, single fixed-effect dimension), the sample (tier, provenance, deduplicated, gov-domain, on-topic), the functional form (log outcome, standardized beta) and the estimator (WLS, Huber RLM, median quantile regression); none replicates the author's primary OLS specification.2026-11-06T19:46
proposedEach claim is probed with six to seven alternatives spanning variance estimators (HC3, jurisdiction clustering), enriched control sets, state-instead-of-region fixed effects, sample restrictions (tier, provenance, deduplication), log functional form, and robust/quantile/weighted estimators, never re-running the author's primary specification.2026-11-06T19:29
proposedEach claim is probed with seven alternative specifications that vary controls, fixed effects, samples, functional forms, and estimators (cluster-robust OLS, WLS by n_live_ballots, median quantile regression); the author's exact primary specifications were not re-run.2026-11-06T19:11
proposedEach claim is probed with eight alternative specifications that vary controls (augmented frame/tier sets, state in place of region fixed effects), samples (multi-rater, local/state-only, de-duplicated, primary-provenance subsets), functional forms (log and log-log outcomes, standardization), and estimators (median quantile, Huber RLM, ballot-weighted WLS); none of these re-runs the author's primar2026-11-06T18:55
proposedEach claim is probed with 6-7 alternatives varying controls, samples, functional form, weights, or estimator (jurisdiction-clustered SEs, median quantile, Huber RLM, WLS); the author's exact primary specifications were not re-run.2026-11-06T18:35
proposedEach claim is probed with six alternatives that vary controls, sample restrictions, fixed-effect granularity, outcome transformation, and estimator (HC3/cluster-robust OLS, inverse-volatility WLS, Huber RLM); the robust-/clustered-SE variants reuse the primary regressors and sample but change only the variance estimator, and no author's primary point-estimating specification is re-run.2026-11-05T18:08
proposedEach alternative keeps the claim's blame_asymmetry estimand but varies controls, sample, functional form, or estimator; OLS/WLS use HC1-robust intervals, RLM uses Huber M-estimation, LAD uses median quantile regression, and winsorized specs clip the outcome at the 1st/99th percentiles within the estimation sample.2026-11-05T17:08
proposedEvery specification keeps blame_asymmetry as the treatment of interest and varies controls, sample, outcome, or estimator relative to each primary specification; no primary specification is re-run.2026-11-05T16:47
proposedFor each claim the alternatives vary the estimator (Huber RLM, median regression, inverse-volatility WLS), the control set (added linguistic controls, added beta/length controls, dropped tone), the fixed-effect granularity (year-quarter), the outcome construction (winsorized, raw return vs CAR), the blame measure (blame_ling), and the sample (pre-open 8-K), with HC3-robust intervals for OLS/WLS an2026-11-05T16:32
proposedEach claim is probed with seven alternatives that vary control sets, samples, functional forms (winsorization, standardization, interaction, horizon/outcome swaps) and estimators (OLS, WLS, median quantile); none re-runs the author's exact primary specification.2026-11-04T19:20
proposedEach specification varies the controls, sample, fixed effects, estimator, or outlier treatment relative to the corresponding primary specification, and intervals are 95% confidence intervals for the blame_asymmetry coefficient from each fitted model.2026-11-04T18:07
proposedEach alternative varies controls, outcome measurement, blame-score measurement, fixed-effect granularity, or estimator (WLS/Huber/winsorized OLS) relative to the primary specifications, which were not re-run.2026-11-04T17:02
proposedEach claim is probed with six alternative specifications varying control sets, fixed-effect granularity, sample restrictions, functional form (median quantile, winsorized outcome) and estimator (WLS); none reproduces the author's primary specification exactly.2026-11-04T16:33
proposedEach claim is probed with six alternative specifications varying fixed-effect structure (firm vs sector), estimator (OLS, Huber RLM, median quantile, WLS), control set, sample (8-K only, drop 2022, exclude extreme day-1 moves), and outcome transformation (winsorization, standardization); none repeats the author's primary specification.2026-11-04T15:57
proposedAll alternatives keep the author's coding of vote and (unless stated) numeric educ/income codes; intervals are 95% Wald intervals, HC1-robust for the linear probability model.2026-10-28T23:33

Validation runs

runstatetiercriticcost
run_01M7B9BZQXF29K8TEEAAS3594Ccompleteddefaultpass$0.3837
run_01M7AV9X35FG5RD7AHZGBV8YGScompleteddefaultpass$0.2973
run_01M79DF76G20PX4VS69BJZTZB4completeddefaultunresolved$0.0011
run_01M78Y0X36SXM3HDH02VNK6QDPcompleteddefaultpass$0.0009
run_01M78RM0VEQC01PGM9VBXF4R0Ncompleteddefaultpass$0.0007
run_01M78NPZJ9R6P91G73MTPYRQ3Hcompleteddefaultpass$0.0007
run_01M76WAM10K99C283Q1KM359WQcompleteddefaultpass$0.0009
run_01M76TZQ7QY6S3TX5B1WYZRXMCcompleteddefaultpass$0.0006
run_01M76BGA8F1FY436XAYBKX1QHZcompleteddefaultpass$0.0008
run_01M74E63MFBXREZSFY2RDQWMW2completeddefaultpass$0.0006
run_01M74DB7TS9MHM241W2FD3ZPZNcompleteddefaultpass$0.0010
run_01M749V1YADD50JRVD2FE5FX87completeddefaultpass$0.0011
run_01M748FS1P29Q9YJFC6T8J6HEEcompleteddefaultpass$0.1835
run_01M73KW1E0MEY2WB4Y6XESPNXYcompleteddefaultpass$0.2794
run_01M6S68HMFCCYA2C8TYCVKAJE8completeddefaultpass$0.3059
run_01M6S58Q50VSV3PM33M56Z3ZSGcompleteddefaultpass$0.2563
run_01M6S48E5F1QRSG30N0SKW223Kcompleteddefaultpass$0.2661
run_01M6S3AXED4Q32X53QMV1DANNWcompleteddefaultpass$0.2935
run_01M6S2645N2M5G56535DJGZ6A1completeddefaultpass$0.3179
run_01M6PE8P20RDWWHDRH9883XVJFcompleteddefaultpass$0.2920
run_01M6PASX19BSWZNNWFAM0RPVRWcompleteddefaultpass$0.2654
run_01M6PAMSDMQKRMA99NJSQGSGYSfaileddefaultunchecked$0.3916
run_01M6P9KYP8RVHTJE16S4BN1X8Wcompleteddefaultpass$0.1856
run_01M6P8S014ASYTQZHAKENN5K1Jcompleteddefaultpass$0.1771
run_01M6M00HJX4X1HTAF9PYFSQA9Acompleteddefaultpass$0.1640
run_01M6KVTMGVJDXFBPBA3KGA8PPAcompleteddefaultpass$0.1551
run_01M6KVQ6E8T6DZ2BHA7QFTNWRVfaileddefaultunchecked$0.0000
run_01M6KR43ND2DTAWJRR295FDPZ1completeddefaultpass$0.1697
run_01M6KPDEFP928TVJMDGYN8P64Xcompleteddefaultpass$0.3221
run_01M6KPAMXS4VEWFT5VWY92ZVHRstarteddefaultunchecked$0.0000