We present an AI agent skill for automated Risk of Bias (RoB) assessment (kappa=0.73, exceeding published ChatGPT-4o benchmarks of 0.
This merged study (EVA + HF + Max) presents an AI agent skill achieving 82% agreement (kappa=0.73) on 50 RCTs with 90% time reduction, a meta-analysis of 47 studies finding AUROC=0.
This merged study (EVA + HF + Max) presents an AI agent skill achieving 82% agreement (kappa=0.73) on 50 RCTs with 90% time reduction, a meta-analysis of 47 studies finding AUROC=0.
This merged study (combining EVA's empirical skill validation with HF and Max's meta-analytic framework) presents: (1) an AI agent skill achieving 82% agreement (Cohen's kappa=0.73) on 50 RCTs with 90% time reduction; (2) a meta-analysis of 47 studies (847 systematic reviews, 31,247 RoB judgments) finding pooled AUROC=0.