Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
horror
mistral nemo
mergekit
Update README.md
Browse files
README.md
CHANGED
|
@@ -259,6 +259,12 @@ This is due to "random" pruning method in "DARE-TIES".
|
|
| 259 |
|
| 260 |
Mistral Nemo models used here seem acutely sensitive to this process.
|
| 261 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 262 |
"tokenizer_source: union" is used so that multiple "templates" work and each fine tune uses one or two of the templates.
|
| 263 |
|
| 264 |
<h3>EXAMPLES PROMPTS and OUTPUT:</h3>
|
|
|
|
| 259 |
|
| 260 |
Mistral Nemo models used here seem acutely sensitive to this process.
|
| 261 |
|
| 262 |
+
This shows up in PPL and "real world" tests as well as "TEMP=0" ("core test") generations.
|
| 263 |
+
|
| 264 |
+
PPL range of 7.7327 to 7.8024 ... and that is on just 10 generations.
|
| 265 |
+
|
| 266 |
+
This model: PPL = PPL = 7.7598 +/- 0.12624 (100 chunks, wiki.test.raw)
|
| 267 |
+
|
| 268 |
"tokenizer_source: union" is used so that multiple "templates" work and each fine tune uses one or two of the templates.
|
| 269 |
|
| 270 |
<h3>EXAMPLES PROMPTS and OUTPUT:</h3>
|