Update README.md
Browse files
README.md
CHANGED
@@ -15,8 +15,8 @@ widget:
|
|
15 |
![](https://huggingface.co/timpal0l/Mistral-7B-v0.1-flashback-v2/resolve/main/flashcat.png?download=true)
|
16 |
|
17 |
|
18 |
-
Mistral-7B-v0.1-flashback-v2
|
19 |
-
It is a full finetune for one epoch. It was finetuned using Axolotl.
|
20 |
|
21 |
## How to use
|
22 |
```python
|
|
|
15 |
![](https://huggingface.co/timpal0l/Mistral-7B-v0.1-flashback-v2/resolve/main/flashcat.png?download=true)
|
16 |
|
17 |
|
18 |
+
*Mistral-7B-v0.1-flashback-v2* is a continuation of the pretraining process for the base Mistral-7B-v0.1 model, utilizing 2 251 233 forum threads from the Swedish website https://www.flashback.org/. Which is rougly 40GB of text.
|
19 |
+
It is a full finetune for one epoch. It was finetuned using [Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl) on 6X Nvidia A100 for about two weeks.
|
20 |
|
21 |
## How to use
|
22 |
```python
|