timpal0l commited on
Commit
f897d66
1 Parent(s): 44e6f8c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -15,8 +15,8 @@ widget:
15
  ![](https://huggingface.co/timpal0l/Mistral-7B-v0.1-flashback-v2/resolve/main/flashcat.png?download=true)
16
 
17
 
18
- Mistral-7B-v0.1-flashback-v2 model is a continuation of the pretraining process for the base Mistral-7B-v0.1 model, utilizing around 40GB of forum threads from the Swedish website flashback.org.
19
- It is a full finetune for one epoch. It was finetuned using Axolotl.
20
 
21
  ## How to use
22
  ```python
 
15
  ![](https://huggingface.co/timpal0l/Mistral-7B-v0.1-flashback-v2/resolve/main/flashcat.png?download=true)
16
 
17
 
18
+ *Mistral-7B-v0.1-flashback-v2* is a continuation of the pretraining process for the base Mistral-7B-v0.1 model, utilizing 2 251 233 forum threads from the Swedish website https://www.flashback.org/. Which is rougly 40GB of text.
19
+ It is a full finetune for one epoch. It was finetuned using [Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl) on 6X Nvidia A100 for about two weeks.
20
 
21
  ## How to use
22
  ```python