Commit
•
7224d02
1
Parent(s):
d61ed54
Upload README.md
Browse files
README.md
CHANGED
|
@@ -1,169 +1,244 @@
|
|
|
|
|
| 1 |
---
|
| 2 |
-
|
| 3 |
-
|
|
|
|
| 4 |
tags:
|
|
|
|
|
|
|
| 5 |
- generated_from_trainer
|
| 6 |
-
|
| 7 |
-
- accuracy
|
| 8 |
model-index:
|
| 9 |
- name: DinoVdeau-giant-2024_08_28-batch-size32_epochs150_freeze
|
| 10 |
results: []
|
| 11 |
---
|
| 12 |
|
| 13 |
-
|
| 14 |
-
should probably proofread and complete it, then remove this comment. -->
|
| 15 |
|
| 16 |
-
# DinoVdeau-giant-2024_08_28-batch-size32_epochs150_freeze
|
| 17 |
-
|
| 18 |
-
This model is a fine-tuned version of [facebook/dinov2-giant](https://huggingface.co/facebook/dinov2-giant) on the None dataset.
|
| 19 |
-
It achieves the following results on the evaluation set:
|
| 20 |
- Loss: 0.1208
|
| 21 |
- F1 Micro: 0.8209
|
| 22 |
- F1 Macro: 0.7101
|
| 23 |
- Roc Auc: 0.8812
|
| 24 |
- Accuracy: 0.3080
|
| 25 |
-
- Learning Rate: 0.0000
|
| 26 |
|
| 27 |
-
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
-
|
| 30 |
|
| 31 |
-
|
| 32 |
|
| 33 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
|
| 37 |
-
|
| 38 |
|
| 39 |
-
|
| 40 |
|
| 41 |
-
|
| 42 |
|
| 43 |
The following hyperparameters were used during training:
|
| 44 |
-
|
| 45 |
-
-
|
| 46 |
-
-
|
| 47 |
-
-
|
| 48 |
-
-
|
| 49 |
-
-
|
| 50 |
-
-
|
| 51 |
-
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
|
| 72 |
-
|
| 73 |
-
|
| 74 |
-
|
| 75 |
-
|
| 76 |
-
|
| 77 |
-
| 0.
|
| 78 |
-
| 0.
|
| 79 |
-
| 0.
|
| 80 |
-
| 0.
|
| 81 |
-
| 0.
|
| 82 |
-
| 0.
|
| 83 |
-
| 0.
|
| 84 |
-
| 0.
|
| 85 |
-
| 0.
|
| 86 |
-
| 0.
|
| 87 |
-
| 0.
|
| 88 |
-
| 0.
|
| 89 |
-
| 0.
|
| 90 |
-
| 0.
|
| 91 |
-
| 0.
|
| 92 |
-
| 0.
|
| 93 |
-
| 0.
|
| 94 |
-
| 0.
|
| 95 |
-
| 0.
|
| 96 |
-
| 0.
|
| 97 |
-
| 0.
|
| 98 |
-
| 0.
|
| 99 |
-
| 0.
|
| 100 |
-
| 0.
|
| 101 |
-
| 0.
|
| 102 |
-
| 0.
|
| 103 |
-
| 0.
|
| 104 |
-
| 0.
|
| 105 |
-
| 0.
|
| 106 |
-
| 0.
|
| 107 |
-
| 0.
|
| 108 |
-
| 0.
|
| 109 |
-
| 0.
|
| 110 |
-
| 0.
|
| 111 |
-
| 0.
|
| 112 |
-
| 0.
|
| 113 |
-
| 0.
|
| 114 |
-
| 0.
|
| 115 |
-
| 0.
|
| 116 |
-
| 0.
|
| 117 |
-
| 0.
|
| 118 |
-
| 0.
|
| 119 |
-
| 0.
|
| 120 |
-
| 0.
|
| 121 |
-
| 0.
|
| 122 |
-
| 0.
|
| 123 |
-
| 0.
|
| 124 |
-
| 0.
|
| 125 |
-
| 0.
|
| 126 |
-
| 0.
|
| 127 |
-
| 0.
|
| 128 |
-
| 0.
|
| 129 |
-
| 0.
|
| 130 |
-
| 0.
|
| 131 |
-
| 0.
|
| 132 |
-
| 0.
|
| 133 |
-
| 0.
|
| 134 |
-
| 0.
|
| 135 |
-
| 0.
|
| 136 |
-
| 0.
|
| 137 |
-
| 0.
|
| 138 |
-
| 0.
|
| 139 |
-
| 0.
|
| 140 |
-
| 0.
|
| 141 |
-
| 0.
|
| 142 |
-
| 0.
|
| 143 |
-
| 0.
|
| 144 |
-
| 0.
|
| 145 |
-
| 0.
|
| 146 |
-
| 0.
|
| 147 |
-
| 0.
|
| 148 |
-
| 0.
|
| 149 |
-
| 0.
|
| 150 |
-
| 0.
|
| 151 |
-
| 0.
|
| 152 |
-
| 0.
|
| 153 |
-
| 0.
|
| 154 |
-
| 0.
|
| 155 |
-
| 0.
|
| 156 |
-
| 0.
|
| 157 |
-
| 0.
|
| 158 |
-
| 0.
|
| 159 |
-
| 0.
|
| 160 |
-
| 0.
|
| 161 |
-
| 0.
|
| 162 |
-
|
| 163 |
-
|
| 164 |
-
|
| 165 |
-
|
| 166 |
-
|
| 167 |
-
|
| 168 |
-
|
| 169 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
---
|
| 3 |
+
language:
|
| 4 |
+
- eng
|
| 5 |
+
license: wtfpl
|
| 6 |
tags:
|
| 7 |
+
- multilabel-image-classification
|
| 8 |
+
- multilabel
|
| 9 |
- generated_from_trainer
|
| 10 |
+
base_model: facebook/dinov2-giant
|
|
|
|
| 11 |
model-index:
|
| 12 |
- name: DinoVdeau-giant-2024_08_28-batch-size32_epochs150_freeze
|
| 13 |
results: []
|
| 14 |
---
|
| 15 |
|
| 16 |
+
DinoVd'eau is a fine-tuned version of [facebook/dinov2-giant](https://huggingface.co/facebook/dinov2-giant). It achieves the following results on the test set:
|
|
|
|
| 17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
- Loss: 0.1208
|
| 19 |
- F1 Micro: 0.8209
|
| 20 |
- F1 Macro: 0.7101
|
| 21 |
- Roc Auc: 0.8812
|
| 22 |
- Accuracy: 0.3080
|
|
|
|
| 23 |
|
| 24 |
+
---
|
| 25 |
+
|
| 26 |
+
# Model description
|
| 27 |
+
DinoVd'eau is a model built on top of dinov2 model for underwater multilabel image classification.The classification head is a combination of linear, ReLU, batch normalization, and dropout layers.
|
| 28 |
|
| 29 |
+
The source code for training the model can be found in this [Git repository](https://github.com/SeatizenDOI/DinoVdeau).
|
| 30 |
|
| 31 |
+
- **Developed by:** [lombardata](https://huggingface.co/lombardata), credits to [César Leblanc](https://huggingface.co/CesarLeblanc) and [Victor Illien](https://huggingface.co/groderg)
|
| 32 |
|
| 33 |
+
---
|
| 34 |
+
|
| 35 |
+
# Intended uses & limitations
|
| 36 |
+
You can use the raw model for classify diverse marine species, encompassing coral morphotypes classes taken from the Global Coral Reef Monitoring Network (GCRMN), habitats classes and seagrass species.
|
| 37 |
+
|
| 38 |
+
---
|
| 39 |
|
| 40 |
+
# Training and evaluation data
|
| 41 |
+
Details on the number of images for each class are given in the following table:
|
| 42 |
+
| Class | train | val | test | Total |
|
| 43 |
+
|:-------------------------|--------:|------:|-------:|--------:|
|
| 44 |
+
| Acropore_branched | 1469 | 464 | 475 | 2408 |
|
| 45 |
+
| Acropore_digitised | 568 | 160 | 160 | 888 |
|
| 46 |
+
| Acropore_sub_massive | 150 | 50 | 43 | 243 |
|
| 47 |
+
| Acropore_tabular | 999 | 297 | 293 | 1589 |
|
| 48 |
+
| Algae_assembly | 2546 | 847 | 845 | 4238 |
|
| 49 |
+
| Algae_drawn_up | 367 | 126 | 127 | 620 |
|
| 50 |
+
| Algae_limestone | 1652 | 557 | 563 | 2772 |
|
| 51 |
+
| Algae_sodding | 3148 | 984 | 985 | 5117 |
|
| 52 |
+
| Atra/Leucospilota | 1084 | 348 | 360 | 1792 |
|
| 53 |
+
| Bleached_coral | 219 | 71 | 70 | 360 |
|
| 54 |
+
| Blurred | 191 | 67 | 62 | 320 |
|
| 55 |
+
| Dead_coral | 1979 | 642 | 643 | 3264 |
|
| 56 |
+
| Fish | 2018 | 656 | 647 | 3321 |
|
| 57 |
+
| Homo_sapiens | 161 | 62 | 59 | 282 |
|
| 58 |
+
| Human_object | 157 | 58 | 55 | 270 |
|
| 59 |
+
| Living_coral | 406 | 154 | 141 | 701 |
|
| 60 |
+
| Millepore | 385 | 127 | 125 | 637 |
|
| 61 |
+
| No_acropore_encrusting | 441 | 130 | 154 | 725 |
|
| 62 |
+
| No_acropore_foliaceous | 204 | 36 | 46 | 286 |
|
| 63 |
+
| No_acropore_massive | 1031 | 336 | 338 | 1705 |
|
| 64 |
+
| No_acropore_solitary | 202 | 53 | 48 | 303 |
|
| 65 |
+
| No_acropore_sub_massive | 1401 | 433 | 422 | 2256 |
|
| 66 |
+
| Rock | 4489 | 1495 | 1473 | 7457 |
|
| 67 |
+
| Rubble | 3092 | 1030 | 1001 | 5123 |
|
| 68 |
+
| Sand | 5842 | 1939 | 1938 | 9719 |
|
| 69 |
+
| Sea_cucumber | 1408 | 439 | 447 | 2294 |
|
| 70 |
+
| Sea_urchins | 327 | 107 | 111 | 545 |
|
| 71 |
+
| Sponge | 269 | 96 | 105 | 470 |
|
| 72 |
+
| Syringodium_isoetifolium | 1212 | 392 | 391 | 1995 |
|
| 73 |
+
| Thalassodendron_ciliatum | 782 | 261 | 260 | 1303 |
|
| 74 |
+
| Useless | 579 | 193 | 193 | 965 |
|
| 75 |
|
| 76 |
+
---
|
| 77 |
|
| 78 |
+
# Training procedure
|
| 79 |
|
| 80 |
+
## Training hyperparameters
|
| 81 |
|
| 82 |
The following hyperparameters were used during training:
|
| 83 |
+
|
| 84 |
+
- **Number of Epochs**: 150
|
| 85 |
+
- **Learning Rate**: 0.001
|
| 86 |
+
- **Train Batch Size**: 32
|
| 87 |
+
- **Eval Batch Size**: 32
|
| 88 |
+
- **Optimizer**: Adam
|
| 89 |
+
- **LR Scheduler Type**: ReduceLROnPlateau with a patience of 5 epochs and a factor of 0.1
|
| 90 |
+
- **Freeze Encoder**: Yes
|
| 91 |
+
- **Data Augmentation**: Yes
|
| 92 |
+
|
| 93 |
+
|
| 94 |
+
## Data Augmentation
|
| 95 |
+
Data were augmented using the following transformations :
|
| 96 |
+
|
| 97 |
+
Train Transforms
|
| 98 |
+
- **PreProcess**: No additional parameters
|
| 99 |
+
- **Resize**: probability=1.00
|
| 100 |
+
- **RandomHorizontalFlip**: probability=0.25
|
| 101 |
+
- **RandomVerticalFlip**: probability=0.25
|
| 102 |
+
- **ColorJiggle**: probability=0.25
|
| 103 |
+
- **RandomPerspective**: probability=0.25
|
| 104 |
+
- **Normalize**: probability=1.00
|
| 105 |
+
|
| 106 |
+
Val Transforms
|
| 107 |
+
- **PreProcess**: No additional parameters
|
| 108 |
+
- **Resize**: probability=1.00
|
| 109 |
+
- **Normalize**: probability=1.00
|
| 110 |
+
|
| 111 |
+
|
| 112 |
+
|
| 113 |
+
## Training results
|
| 114 |
+
Epoch | Validation Loss | Accuracy | F1 Macro | F1 Micro | Learning Rate
|
| 115 |
+
--- | --- | --- | --- | --- | ---
|
| 116 |
+
1 | 0.17437300086021423 | 0.21205821205821207 | 0.7424333879451582 | 0.5175126673232894 | 0.001
|
| 117 |
+
2 | 0.1514047533273697 | 0.24774774774774774 | 0.7776526996039191 | 0.5912510936495889 | 0.001
|
| 118 |
+
3 | 0.1557399332523346 | 0.23873873873873874 | 0.7752795082305376 | 0.6203462640123141 | 0.001
|
| 119 |
+
4 | 0.1499096304178238 | 0.2494802494802495 | 0.7691087713115115 | 0.6112936548561337 | 0.001
|
| 120 |
+
5 | 0.15773828327655792 | 0.24497574497574498 | 0.7744962975718961 | 0.6316545255681125 | 0.001
|
| 121 |
+
6 | 0.1529887616634369 | 0.25744975744975745 | 0.7803354441211706 | 0.6220908262048482 | 0.001
|
| 122 |
+
7 | 0.14232446253299713 | 0.2616077616077616 | 0.7837652308220353 | 0.6318272608971183 | 0.001
|
| 123 |
+
8 | 0.14342056214809418 | 0.2591822591822592 | 0.7824785045129828 | 0.6268140575796306 | 0.001
|
| 124 |
+
9 | 0.14322087168693542 | 0.25848925848925847 | 0.7840562521179261 | 0.6406683603322132 | 0.001
|
| 125 |
+
10 | 0.15065954625606537 | 0.2591822591822592 | 0.7779440239394473 | 0.6350156993693012 | 0.001
|
| 126 |
+
11 | 0.14012028276920319 | 0.26853776853776856 | 0.7905542412977358 | 0.6442254017268965 | 0.001
|
| 127 |
+
12 | 0.14037516713142395 | 0.26056826056826055 | 0.7896027049873203 | 0.6412994039301575 | 0.001
|
| 128 |
+
13 | 0.1420680731534958 | 0.2695772695772696 | 0.7822141560798549 | 0.6359393136512833 | 0.001
|
| 129 |
+
14 | 0.13944004476070404 | 0.2636867636867637 | 0.7887275978034142 | 0.6459907944955716 | 0.001
|
| 130 |
+
15 | 0.13796783983707428 | 0.2553707553707554 | 0.7915315007683115 | 0.6554204386045119 | 0.001
|
| 131 |
+
16 | 0.1441228836774826 | 0.255024255024255 | 0.7857792404624779 | 0.6452554527968026 | 0.001
|
| 132 |
+
17 | 0.14113685488700867 | 0.26784476784476785 | 0.7904489177124567 | 0.6485416937632181 | 0.001
|
| 133 |
+
18 | 0.1381485015153885 | 0.26056826056826055 | 0.7940517933336151 | 0.654854199500387 | 0.001
|
| 134 |
+
19 | 0.13720253109931946 | 0.2654192654192654 | 0.793669650812508 | 0.6522812524843972 | 0.001
|
| 135 |
+
20 | 0.13964051008224487 | 0.253984753984754 | 0.791502353390154 | 0.6515497507659908 | 0.001
|
| 136 |
+
21 | 0.13785456120967865 | 0.2577962577962578 | 0.7925025501530093 | 0.6542904488686327 | 0.001
|
| 137 |
+
22 | 0.13633865118026733 | 0.2661122661122661 | 0.7952276188864443 | 0.6524154901292529 | 0.001
|
| 138 |
+
23 | 0.13627886772155762 | 0.27096327096327094 | 0.7961679924728424 | 0.656651787807274 | 0.001
|
| 139 |
+
24 | 0.14012865722179413 | 0.2661122661122661 | 0.7871861324722778 | 0.6438900918479138 | 0.001
|
| 140 |
+
25 | 0.1359640210866928 | 0.27546777546777546 | 0.7960565795113589 | 0.6538094573584412 | 0.001
|
| 141 |
+
26 | 0.1370791494846344 | 0.2692307692307692 | 0.7942222975262623 | 0.6407905722004358 | 0.001
|
| 142 |
+
27 | 0.13669614493846893 | 0.2654192654192654 | 0.7902460077686664 | 0.6469565906332285 | 0.001
|
| 143 |
+
28 | 0.1371130496263504 | 0.26888426888426886 | 0.7912144926283021 | 0.642689033704319 | 0.001
|
| 144 |
+
29 | 0.13781629502773285 | 0.2692307692307692 | 0.7944120277694962 | 0.6484600603294314 | 0.001
|
| 145 |
+
30 | 0.13641151785850525 | 0.26507276507276506 | 0.7938241064573914 | 0.6472439075890195 | 0.001
|
| 146 |
+
31 | 0.13565559685230255 | 0.2747747747747748 | 0.7999161777032691 | 0.6533472550118105 | 0.001
|
| 147 |
+
32 | 0.137930765748024 | 0.2664587664587665 | 0.7928646379853095 | 0.662032330499469 | 0.001
|
| 148 |
+
33 | 0.13557712733745575 | 0.273042273042273 | 0.7989514185446704 | 0.6722007856831675 | 0.001
|
| 149 |
+
34 | 0.1347290426492691 | 0.273042273042273 | 0.7966670917825107 | 0.670590685863264 | 0.001
|
| 150 |
+
35 | 0.13544337451457977 | 0.2772002772002772 | 0.7946646145953571 | 0.6482708127714739 | 0.001
|
| 151 |
+
36 | 0.13763058185577393 | 0.25848925848925847 | 0.7927604900328681 | 0.6552995006011981 | 0.001
|
| 152 |
+
37 | 0.13456694781780243 | 0.2747747747747748 | 0.7992204380799051 | 0.6680976075122991 | 0.001
|
| 153 |
+
38 | 0.13784632086753845 | 0.27165627165627165 | 0.7889066758966815 | 0.6543467314054483 | 0.001
|
| 154 |
+
39 | 0.13671767711639404 | 0.2664587664587665 | 0.7965357098029371 | 0.6627442989440849 | 0.001
|
| 155 |
+
40 | 0.13730555772781372 | 0.27373527373527373 | 0.8004978220286246 | 0.670153584497431 | 0.001
|
| 156 |
+
41 | 0.13770104944705963 | 0.26576576576576577 | 0.7942296990711015 | 0.6610276871242879 | 0.001
|
| 157 |
+
42 | 0.13536451756954193 | 0.28101178101178104 | 0.8001525876319246 | 0.6705886094654014 | 0.001
|
| 158 |
+
43 | 0.13665379583835602 | 0.26507276507276506 | 0.8000498525196295 | 0.6619628883017729 | 0.001
|
| 159 |
+
44 | 0.12908011674880981 | 0.2869022869022869 | 0.808658516161447 | 0.6825865030851337 | 0.0001
|
| 160 |
+
45 | 0.12761357426643372 | 0.29972279972279975 | 0.811512367788968 | 0.6938587241702103 | 0.0001
|
| 161 |
+
46 | 0.12698666751384735 | 0.2959112959112959 | 0.8103163511624953 | 0.6856377454961721 | 0.0001
|
| 162 |
+
47 | 0.12690682709217072 | 0.2972972972972973 | 0.8124920976103174 | 0.6942647446672258 | 0.0001
|
| 163 |
+
48 | 0.12617328763008118 | 0.29799029799029797 | 0.8131711409395973 | 0.694151320978192 | 0.0001
|
| 164 |
+
49 | 0.1263018250465393 | 0.2966042966042966 | 0.8147346514047868 | 0.6956458198072734 | 0.0001
|
| 165 |
+
50 | 0.1258096992969513 | 0.2927927927927928 | 0.8153475224476222 | 0.7006577033751422 | 0.0001
|
| 166 |
+
51 | 0.12573884427547455 | 0.2972972972972973 | 0.8151571934207786 | 0.6994505755010588 | 0.0001
|
| 167 |
+
52 | 0.12501972913742065 | 0.2972972972972973 | 0.8134649455833967 | 0.6974514657531053 | 0.0001
|
| 168 |
+
53 | 0.12481856346130371 | 0.2948717948717949 | 0.8132960287301124 | 0.6962280886309719 | 0.0001
|
| 169 |
+
54 | 0.12473563104867935 | 0.30180180180180183 | 0.8143470573377115 | 0.6980743235485474 | 0.0001
|
| 170 |
+
55 | 0.12453257292509079 | 0.30076230076230076 | 0.8165587111775452 | 0.7020497284253308 | 0.0001
|
| 171 |
+
56 | 0.12440259009599686 | 0.3011088011088011 | 0.8185497191939213 | 0.7041152638460181 | 0.0001
|
| 172 |
+
57 | 0.12393573671579361 | 0.3004158004158004 | 0.8162207357859533 | 0.6984123654445143 | 0.0001
|
| 173 |
+
58 | 0.12355069816112518 | 0.30006930006930005 | 0.8171478565179352 | 0.7041206694443728 | 0.0001
|
| 174 |
+
59 | 0.1237163171172142 | 0.3049203049203049 | 0.8158932617269447 | 0.701908769020469 | 0.0001
|
| 175 |
+
60 | 0.12339853495359421 | 0.29902979902979904 | 0.8152564590468943 | 0.7008492179245241 | 0.0001
|
| 176 |
+
61 | 0.12294851988554001 | 0.3024948024948025 | 0.8188720173535793 | 0.7083200505706103 | 0.0001
|
| 177 |
+
62 | 0.12270853668451309 | 0.30284130284130284 | 0.8166017506386899 | 0.7054890147149661 | 0.0001
|
| 178 |
+
63 | 0.12301415950059891 | 0.3038808038808039 | 0.8176490288010717 | 0.7105833307429198 | 0.0001
|
| 179 |
+
64 | 0.12328237295150757 | 0.3049203049203049 | 0.8191759178412541 | 0.7085844813380441 | 0.0001
|
| 180 |
+
65 | 0.12309526652097702 | 0.3049203049203049 | 0.8187567612548888 | 0.7103887558295827 | 0.0001
|
| 181 |
+
66 | 0.12194398790597916 | 0.30284130284130284 | 0.8186407442947141 | 0.7061406642055487 | 0.0001
|
| 182 |
+
67 | 0.12292120605707169 | 0.3042273042273042 | 0.8196775527077305 | 0.7154558287425048 | 0.0001
|
| 183 |
+
68 | 0.12254418432712555 | 0.30803880803880807 | 0.8209686046990085 | 0.7153434473934246 | 0.0001
|
| 184 |
+
69 | 0.12215162813663483 | 0.3031878031878032 | 0.8195983668027664 | 0.7101570111652898 | 0.0001
|
| 185 |
+
70 | 0.12227334082126617 | 0.30838530838530837 | 0.8184682603033231 | 0.7109091736321397 | 0.0001
|
| 186 |
+
71 | 0.12237659096717834 | 0.3076923076923077 | 0.8170385739086251 | 0.7120407268503043 | 0.0001
|
| 187 |
+
72 | 0.1220996230840683 | 0.3063063063063063 | 0.8203632727878687 | 0.7203981522602361 | 0.0001
|
| 188 |
+
73 | 0.12169401347637177 | 0.3087318087318087 | 0.8198457369189076 | 0.7144193511981376 | 1e-05
|
| 189 |
+
74 | 0.12149834632873535 | 0.30665280665280664 | 0.8190452070406484 | 0.7124121424308173 | 1e-05
|
| 190 |
+
75 | 0.12120900303125381 | 0.30561330561330563 | 0.8208643316893754 | 0.7145366354361308 | 1e-05
|
| 191 |
+
76 | 0.1215985044836998 | 0.30803880803880807 | 0.8218541121766927 | 0.7191205487713891 | 1e-05
|
| 192 |
+
77 | 0.1214083805680275 | 0.31323631323631324 | 0.8236983547367989 | 0.7202749659896155 | 1e-05
|
| 193 |
+
78 | 0.12110316008329391 | 0.3097713097713098 | 0.8222591362126246 | 0.7168480610158249 | 1e-05
|
| 194 |
+
79 | 0.12149946391582489 | 0.30665280665280664 | 0.8202977563430488 | 0.7160500850094047 | 1e-05
|
| 195 |
+
80 | 0.121590256690979 | 0.30734580734580735 | 0.8219257062844905 | 0.7150848378423871 | 1e-05
|
| 196 |
+
81 | 0.12097962200641632 | 0.3115038115038115 | 0.8216162121591194 | 0.7187103786018064 | 1e-05
|
| 197 |
+
82 | 0.12082336097955704 | 0.30942480942480943 | 0.821175978238125 | 0.7156786549052798 | 1e-05
|
| 198 |
+
83 | 0.12147542089223862 | 0.30006930006930005 | 0.8180206046275968 | 0.7102312532643303 | 1e-05
|
| 199 |
+
84 | 0.12100570648908615 | 0.31185031185031187 | 0.8215978053038491 | 0.7195842513107142 | 1e-05
|
| 200 |
+
85 | 0.1208326444029808 | 0.31011781011781014 | 0.8233587533156498 | 0.7201395616901511 | 1e-05
|
| 201 |
+
86 | 0.1210438683629036 | 0.30942480942480943 | 0.8218151540383014 | 0.7215167678270465 | 1e-05
|
| 202 |
+
87 | 0.1212099939584732 | 0.3087318087318087 | 0.8207271207689094 | 0.7141558876633265 | 1e-05
|
| 203 |
+
88 | 0.12096676975488663 | 0.31011781011781014 | 0.8223957468017943 | 0.7124615854591595 | 1e-05
|
| 204 |
+
89 | 0.12144902348518372 | 0.3121968121968122 | 0.8240642149234173 | 0.7249978662662346 | 1.0000000000000002e-06
|
| 205 |
+
90 | 0.12115956842899323 | 0.31046431046431044 | 0.8233893154847453 | 0.7198781344667567 | 1.0000000000000002e-06
|
| 206 |
+
91 | 0.1208055168390274 | 0.3097713097713098 | 0.8212459126351974 | 0.7159843095789674 | 1.0000000000000002e-06
|
| 207 |
+
92 | 0.12069901078939438 | 0.30734580734580735 | 0.8223893065998329 | 0.7144036362020703 | 1.0000000000000002e-06
|
| 208 |
+
93 | 0.12093978375196457 | 0.30803880803880807 | 0.8226574468966088 | 0.7189178649032102 | 1.0000000000000002e-06
|
| 209 |
+
94 | 0.12092197686433792 | 0.3097713097713098 | 0.8223438666334908 | 0.7187657914933285 | 1.0000000000000002e-06
|
| 210 |
+
95 | 0.1206900030374527 | 0.30942480942480943 | 0.8221934621968021 | 0.7127077698746517 | 1.0000000000000002e-06
|
| 211 |
+
96 | 0.12142115086317062 | 0.30665280665280664 | 0.8218438538205979 | 0.7160309422692305 | 1.0000000000000002e-06
|
| 212 |
+
97 | 0.12264719605445862 | 0.30942480942480943 | 0.8208711661575798 | 0.71586766610014 | 1.0000000000000002e-06
|
| 213 |
+
98 | 0.12095578759908676 | 0.31185031185031187 | 0.8224561403508771 | 0.7190138873820752 | 1.0000000000000002e-06
|
| 214 |
+
99 | 0.12075632065534592 | 0.3097713097713098 | 0.821403230518803 | 0.7177436878101541 | 1.0000000000000002e-07
|
| 215 |
+
100 | 0.12078335881233215 | 0.3108108108108108 | 0.8218776194467728 | 0.7191112023643382 | 1.0000000000000002e-07
|
| 216 |
+
101 | 0.12071150541305542 | 0.3097713097713098 | 0.8230599775551769 | 0.7199208624613478 | 1.0000000000000002e-07
|
| 217 |
+
102 | 0.12102664262056351 | 0.31011781011781014 | 0.821560093739538 | 0.7181176324357539 | 1.0000000000000002e-07
|
| 218 |
+
103 | 0.12072332948446274 | 0.31115731115731116 | 0.8218559116391932 | 0.7156251632807489 | 1.0000000000000002e-07
|
| 219 |
+
104 | 0.12122868001461029 | 0.3090783090783091 | 0.8214226220223222 | 0.7151217785983346 | 1.0000000000000002e-07
|
| 220 |
+
105 | 0.12081456929445267 | 0.30838530838530837 | 0.8216449497883642 | 0.7175066761763569 | 1.0000000000000004e-08
|
| 221 |
+
|
| 222 |
+
|
| 223 |
+
---
|
| 224 |
+
|
| 225 |
+
# CO2 Emissions
|
| 226 |
+
|
| 227 |
+
The estimated CO2 emissions for training this model are documented below:
|
| 228 |
+
|
| 229 |
+
- **Emissions**: 0.5035923822963007 grams of CO2
|
| 230 |
+
- **Source**: Code Carbon
|
| 231 |
+
- **Training Type**: fine-tuning
|
| 232 |
+
- **Geographical Location**: Brest, France
|
| 233 |
+
- **Hardware Used**: NVIDIA Tesla V100 PCIe 32 Go
|
| 234 |
+
|
| 235 |
+
|
| 236 |
+
---
|
| 237 |
+
|
| 238 |
+
# Framework Versions
|
| 239 |
+
|
| 240 |
+
- **Transformers**: 4.41.1
|
| 241 |
+
- **Pytorch**: 2.3.0+cu121
|
| 242 |
+
- **Datasets**: 2.19.1
|
| 243 |
+
- **Tokenizers**: 0.19.1
|
| 244 |
+
|