Speech to text, word error
Starting point71.6%
Akuru today52.3%
Base Whisper turbo vs akuru-raalhu-P-1.0, 1.97 h of conversational Dhivehi (lower is better)
Akuru builds on more than five months of Dhivehi research and model development. This is what exists now, and how it measures.
Base Whisper turbo vs akuru-raalhu-P-1.0, 1.97 h of conversational Dhivehi (lower is better)
Same test (lower is better)
Base MADLAD-400 vs akuru-bathheli-T-1.2, 300 held-out pairs (higher is better)
Same test (higher is better)
akuru-loa-T-2.0 on 32 pages of scans and screenshots
akuru-dhoni-T-1.1 vs four other open setups, 200 questions; a frontier model scores 4.90, which is the gap we are closing