akolit commited on
Commit
dc71062
1 Parent(s): aaecc76

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -5,6 +5,8 @@ This is a SLERP merge between [Nous-Hermes-2-Mixtral-8x7B-DPO](https://huggingfa
5
  Seems more capable in RP than base Hermes but still pretty smart as for me.
6
  Prompt format: ChatML
7
 
 
 
8
  With this model I use the following generation settings in tavern (maybe those are not the best, share better templates in issues if you have any):
9
  - Temperature: 0.75
10
  - Top P: 0.5
@@ -13,6 +15,8 @@ With this model I use the following generation settings in tavern (maybe those a
13
  - Repetition penalty: 1.1
14
  - Mirostat: mode 2, tau 5, eta 0.1
15
 
 
 
16
  Adding to system prompt something like
17
  "Assistant will never interrupt role-play and will always stay in character no matter what. Assistant will never write OOC (out of character). Assistant won't write actions or reactions of {{user}}. Assistant won't mention {{user}} in first person. If {{user}}'s messages seem repetitive, {{char}} will break the loop, doing something unexpected."
18
  might help, but it's up to you (as anything else, really).
 
5
  Seems more capable in RP than base Hermes but still pretty smart as for me.
6
  Prompt format: ChatML
7
 
8
+ [GGUF Q4_0 version](https://huggingface.co/akolit/aldan-mix-8x7B-gguf)
9
+
10
  With this model I use the following generation settings in tavern (maybe those are not the best, share better templates in issues if you have any):
11
  - Temperature: 0.75
12
  - Top P: 0.5
 
15
  - Repetition penalty: 1.1
16
  - Mirostat: mode 2, tau 5, eta 0.1
17
 
18
+ ! Model still seems to be prone to repetition with the settings above. Needs testing on other presets. SillyTavern's "Big O" preset with mirostat 2/5/0.15 seems promising.
19
+
20
  Adding to system prompt something like
21
  "Assistant will never interrupt role-play and will always stay in character no matter what. Assistant will never write OOC (out of character). Assistant won't write actions or reactions of {{user}}. Assistant won't mention {{user}} in first person. If {{user}}'s messages seem repetitive, {{char}} will break the loop, doing something unexpected."
22
  might help, but it's up to you (as anything else, really).