Suparious commited on
Commit
31e3f7f
1 Parent(s): 58995e8

Add ChatML style prompt example

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -43,3 +43,13 @@ It is supported by:
43
  - [Hugging Face Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference)
44
  - [Transformers](https://huggingface.co/docs/transformers) version 4.35.0 and later, from any code or client that supports Transformers
45
  - [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) - for use from Python code
 
 
 
 
 
 
 
 
 
 
 
43
  - [Hugging Face Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference)
44
  - [Transformers](https://huggingface.co/docs/transformers) version 4.35.0 and later, from any code or client that supports Transformers
45
  - [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) - for use from Python code
46
+
47
+ ## Prompt template: ChatML
48
+
49
+ ```plaintext
50
+ <|im_start|>system
51
+ {system_message}<|im_end|>
52
+ <|im_start|>user
53
+ {prompt}<|im_end|>
54
+ <|im_start|>assistant
55
+ ```