yemen2016 commited on
Commit
cdbc308
1 Parent(s): 05a7f86

End of training

Browse files
README.md ADDED
@@ -0,0 +1,78 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: cc-by-4.0
4
+ base_model: vesteinn/DanskBERT
5
+ tags:
6
+ - generated_from_trainer
7
+ model-index:
8
+ - name: danskbert_ED
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # danskbert_ED
16
+
17
+ This model is a fine-tuned version of [vesteinn/DanskBERT](https://huggingface.co/vesteinn/DanskBERT) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.7439
20
+ - F1-score: 0.8339
21
+
22
+ ## Model description
23
+
24
+ More information needed
25
+
26
+ ## Intended uses & limitations
27
+
28
+ More information needed
29
+
30
+ ## Training and evaluation data
31
+
32
+ More information needed
33
+
34
+ ## Training procedure
35
+
36
+ ### Training hyperparameters
37
+
38
+ The following hyperparameters were used during training:
39
+ - learning_rate: 5e-05
40
+ - train_batch_size: 8
41
+ - eval_batch_size: 8
42
+ - seed: 42
43
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
+ - lr_scheduler_type: linear
45
+ - num_epochs: 20
46
+
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss | F1-score |
50
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
51
+ | No log | 1.0 | 69 | 0.6389 | 0.8014 |
52
+ | No log | 2.0 | 138 | 0.6085 | 0.7654 |
53
+ | No log | 3.0 | 207 | 0.7439 | 0.8339 |
54
+ | No log | 4.0 | 276 | 0.8447 | 0.8273 |
55
+ | No log | 5.0 | 345 | 0.9992 | 0.8193 |
56
+ | No log | 6.0 | 414 | 1.4570 | 0.7775 |
57
+ | No log | 7.0 | 483 | 1.4951 | 0.8029 |
58
+ | 0.2302 | 8.0 | 552 | 1.7546 | 0.7769 |
59
+ | 0.2302 | 9.0 | 621 | 1.5325 | 0.8115 |
60
+ | 0.2302 | 10.0 | 690 | 1.6252 | 0.8033 |
61
+ | 0.2302 | 11.0 | 759 | 1.5428 | 0.8197 |
62
+ | 0.2302 | 12.0 | 828 | 1.5487 | 0.8278 |
63
+ | 0.2302 | 13.0 | 897 | 1.5563 | 0.8195 |
64
+ | 0.2302 | 14.0 | 966 | 1.5723 | 0.8195 |
65
+ | 0.0017 | 15.0 | 1035 | 1.5878 | 0.8276 |
66
+ | 0.0017 | 16.0 | 1104 | 1.6001 | 0.8276 |
67
+ | 0.0017 | 17.0 | 1173 | 1.6105 | 0.8276 |
68
+ | 0.0017 | 18.0 | 1242 | 1.6195 | 0.8276 |
69
+ | 0.0017 | 19.0 | 1311 | 1.6236 | 0.8276 |
70
+ | 0.0017 | 20.0 | 1380 | 1.6166 | 0.8278 |
71
+
72
+
73
+ ### Framework versions
74
+
75
+ - Transformers 4.44.2
76
+ - Pytorch 2.4.0+cu121
77
+ - Datasets 2.21.0
78
+ - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a307e73ab5ea6448471b1201f75d436210e52bf15c9f43768fe9b7422b56bcc
3
  size 497814104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a13eda6e697ffe343c49f96d51be832b340f47a8639eb76da2c8b852ecba1ecc
3
  size 497814104
runs/Sep09_13-13-21_4c67059b5fce/events.out.tfevents.1725887648.4c67059b5fce.1484.6 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5dd7e9e2a9ce068f5c12f127f3922acc1be1fe969690800483aab20ebc13e234
3
- size 11985
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1691a321ee8b04a79eed1d143295925d36da74b5227e7dbd349735cfb9fa3012
3
+ size 12339
runs/Sep09_13-13-21_4c67059b5fce/events.out.tfevents.1725888547.4c67059b5fce.1484.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c1e4a06d930e8636c93702f1e5fd37229e4719adc70ff6de6f18dddd30f0f92
3
+ size 411