- Why
- A playgroup needed a fair comparison of models on the same real charity PDFs, with the same fields and the same score.
- Problem
- UK charity annual reports are PDFs. Eight financial fields have to come out correctly, and models differ in accuracy, failed runs, time, and cost.
- Built
- A scored extractor across OpenRouter, Doubleword, and V7 Go, plus a public playground of every run.
- Result
- 122 scored runs. The best models reach about 0.95 F1. Provider averages and failures are on the leaderboard, so a choice is a comparison.