SanctionBench Leaderboard

Benchmark version 1.0.0. Built from 1 validated aggregate submission.

Development mock and self-reported results are not official. Official results require an organizer-run private-holdout evaluation.

Metric definitions

SanctionScore is offending-authority recall on a 0 to 100 scale. Clean audits are documents with no missed offending authorities. FPR and control alarms measure incorrect flags against real authorities or clean control documents. Extra reviews per document counts flags that require additional verification.

Scroll horizontally to view all metrics.

TierModelRevisionOrganic closedOrganic clean audits Control alarmsOrganic extra reviews/docCitation closedClosed FPR Citation toolTool FPRDocument closedDocument tool Tool clean auditsTool extra reviews/docQueries
development_mockmock/deterministic-rule-based-v1deterministic-rule-based-v1N/AN/AN/AN/A41.6733.33%100.008.33%75.00100.00100.00%1.0050