Update README.md
Browse files
README.md
CHANGED
|
@@ -195,29 +195,29 @@ no instruction tuning or fine-tuning of any kind has been performed.
|
|
| 195 |
| XNLI | ca | Natural Language Inference| acc | 48.8 | **50.24** |
|
| 196 |
| Teca | ca | Natural Language Inference| acc | 46.62 | **49.79** |
|
| 197 |
| WNLI | ca | Natural Language Inference| acc | **57.75** | 54.93 |
|
| 198 |
-
|
|
| 199 |
-
|
|
| 200 |
-
|
|
| 201 |
| Mgsm direct | ca | Math |exact match | **0.03** | 0 |
|
| 202 |
-
| VeritasQA Gen | ca | Truthfulness |
|
| 203 |
| VeritasQA MC1 | ca | Truthfulness | acc | **23.18** | 22.35 |
|
| 204 |
| VeritasQA MC2 | ca | Truthfulness | acc | 34.95 | **35.19**|
|
| 205 |
-
| Phrases ca-va | ca/va| Translation - Adaptation |
|
| 206 |
-
| Phrases va-ca | ca/va| Translation - Adaptation |
|
| 207 |
| Belebele Cat_latn | es | Reading Comprehension | acc | **25.56** | 22.33 |
|
| 208 |
| PAWS | es | Paraphrasing | acc | 56.5 | **57.5** |
|
| 209 |
| Escola | es | Paraphrasing | acc | **0.02** | 0 |
|
| 210 |
| XStoryCloze | es | Commonsense Reasoning | f1 | 68.46 | **69.76** |
|
| 211 |
| XQuAD | es | Question Answering | f1 | 58.85 | **63.59** |
|
| 212 |
-
|
|
| 213 |
-
|
|
| 214 |
-
| VeritasQA Gen | es | Truthfulness |
|
| 215 |
| VeritasQA MC1 | es | Truthfulness | acc | **23.46** | 21.51 |
|
| 216 |
| VeritasQA MC2 | es | Truthfulness | acc | **37.52** | 34.74|
|
| 217 |
| XNLI | es | Natural Language Inference| acc | 46.67 | **47.87**|
|
| 218 |
| WNLI | es | Natural Language Inference| acc | 53.52 | **56.34** |
|
| 219 |
-
| Phrases es-va | es/va| Translation |
|
| 220 |
-
| Phrases va-es | va/es| Translation |
|
| 221 |
|
| 222 |
|
| 223 |
## Additional information
|
|
|
|
| 195 |
| XNLI | ca | Natural Language Inference| acc | 48.8 | **50.24** |
|
| 196 |
| Teca | ca | Natural Language Inference| acc | 46.62 | **49.79** |
|
| 197 |
| WNLI | ca | Natural Language Inference| acc | **57.75** | 54.93 |
|
| 198 |
+
| caBreu Extractive | ca | Summarization | rouge1 | **50.94** | 36.21 |
|
| 199 |
+
| caBreu Abstractive | ca | Summarization | bleu | 5.27 | **7.11** |
|
| 200 |
+
| caBreu Extreme | ca | Summarization | bleu | 1.72 | **4.4** |
|
| 201 |
| Mgsm direct | ca | Math |exact match | **0.03** | 0 |
|
| 202 |
+
| VeritasQA Gen | ca | Truthfulness | bleu | 4.18 | **21.56**|
|
| 203 |
| VeritasQA MC1 | ca | Truthfulness | acc | **23.18** | 22.35 |
|
| 204 |
| VeritasQA MC2 | ca | Truthfulness | acc | 34.95 | **35.19**|
|
| 205 |
+
| Phrases ca-va | ca/va| Translation - Adaptation | bleu | 89.12 | **90.3** |
|
| 206 |
+
| Phrases va-ca | ca/va| Translation - Adaptation | bleu | **93.23** | **92.99**|
|
| 207 |
| Belebele Cat_latn | es | Reading Comprehension | acc | **25.56** | 22.33 |
|
| 208 |
| PAWS | es | Paraphrasing | acc | 56.5 | **57.5** |
|
| 209 |
| Escola | es | Paraphrasing | acc | **0.02** | 0 |
|
| 210 |
| XStoryCloze | es | Commonsense Reasoning | f1 | 68.46 | **69.76** |
|
| 211 |
| XQuAD | es | Question Answering | f1 | 58.85 | **63.59** |
|
| 212 |
+
| XLSum | es | Summarization | bleu | 0.88 | **1.79** |
|
| 213 |
+
| MGSM Direct | es | Math |exact match | **0.02** | 0 |
|
| 214 |
+
| VeritasQA Gen | es | Truthfulness | bleu | 13.57 | **22.11**|
|
| 215 |
| VeritasQA MC1 | es | Truthfulness | acc | **23.46** | 21.51 |
|
| 216 |
| VeritasQA MC2 | es | Truthfulness | acc | **37.52** | 34.74|
|
| 217 |
| XNLI | es | Natural Language Inference| acc | 46.67 | **47.87**|
|
| 218 |
| WNLI | es | Natural Language Inference| acc | 53.52 | **56.34** |
|
| 219 |
+
| Phrases es-va | es/va| Translation | bleu | 70.28 | **70.52**|
|
| 220 |
+
| Phrases va-es | va/es| Translation | bleu | 79.63 | **79.87**|
|
| 221 |
|
| 222 |
|
| 223 |
## Additional information
|