Published in full
Transcription accuracy benchmarks
KolWrite publishes the full results of its own accuracy tests: every transcript, the scoring method and a script that recomputes the figures. Hebrew is measured so far. More languages are being measured; a language appears here only when its per-clip file is public.
Languages measured
| Language | Test | Measured | Oracle Max word error rate (95% interval) | Engines compared | Report |
|---|---|---|---|---|---|
| Hebrew | FLEURS, all 792 clips | 21 November 2026 | 12.6% (11.2% to 14.1%) | 21 others | Hebrew report |
On all 792 clips of the Hebrew FLEURS test, measured on 21 November 2026, KolWrite Oracle Max had a word error rate of 12.6% (95% interval 11.2% to 14.1%), the lowest of the 22 engines in the comparison; the next lowest published figure is 17.4%.
How we publish
- Every result comes with its per-clip file, so anyone can rescore it. The files are on this site with their SHA-256.
- The method is that of a public third-party leaderboard. The other engines' figures are the leaderboard's own, in the versions and on the dates it lists; we did not run them.
- A clip that failed or came back empty is counted as an empty transcript. No clip is dropped.
- We measured our own product and say so. We do not say that Oracle Max has the lowest error rate in a language we have not measured.
- If you find an error, write to [email protected].
Run it on your own account
Each report ends with the exact API requests and the script that rescores the published file. Running the whole Hebrew set (2.05 hours of audio) on Oracle Max is about US$7.38 at the published rate of US$3.60 per audio hour.