| Model description: cat-eus | |
| Date: 2024-08-12 | |
| TF version 2.10.0, OpenNMT version 2.29.1, CTranslate2 version 3.22.0 | |
| Test data set | |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 27.3 (μ = 27.3 ± 0.3) 59.6/33.6/21.4/14.4 (BP = 0.973 ratio = 0.973 hyp_len = 310620 ref_len = 319206) | |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 63.1 (μ = 63.1 ± 0.2) | |
| Flores data set | |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 17.1 (μ = 17.1 ± 0.9) 49.8/22.5/11.8/6.6 (BP = 0.998 ratio = 0.998 hyp_len = 20755 ref_len = 20788) | |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 56.2 (μ = 56.1 ± 0.6) | |