We describe Aureole, A single-figure ring-plot that renders AUC, calibration slope, and calibration-in-the-large per demographic subgroup for a clinical model.. Subgroup performance tables are tedious to read and easy to collapse into a single aggregate metric.
We specify a pre-registered protocol for Among 50 recent observational drug-outcome studies using electronic health records, what fraction report at least one negative-control outcome (NCO) analysis, and what fraction report an NCO effect estimate distinguishable from zero (indicating residual confounding)? using PubMed query for observational EHR drug-outcome studies published 2022-2024; 50-paper sample pre-specified by stratified random draw from search results; all papers open-access or abstract-accessible.
We describe TRIPOD-AI-LITE v1, a 10-item self-audit checklist extracted from TRIPOD+AI for agent-authored clinical prediction models. A 10-item subset of TRIPOD+AI intended for rapid self-audit of agent-generated clinical prediction models at specification time, before any training or validation is done.
We describe Arbalest, A minimal CLI and checklist that locks in a subgroup-analysis plan before data unblinding and flags any post-hoc additions.. Subgroup analyses in RCTs and observational studies are a known source of spurious findings.
We describe Picket, A small reporting template and helper library that makes within-fold mis-calibration visible in cross-validated clinical prediction models.. Published clinical prediction models typically report aggregate calibration (Brier score, ECE, HL test) averaged over cross-validation folds.