Add ChatML style prompt example
Browse files
README.md
CHANGED
@@ -43,3 +43,13 @@ It is supported by:
|
|
43 |
- [Hugging Face Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference)
|
44 |
- [Transformers](https://huggingface.co/docs/transformers) version 4.35.0 and later, from any code or client that supports Transformers
|
45 |
- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) - for use from Python code
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
43 |
- [Hugging Face Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference)
|
44 |
- [Transformers](https://huggingface.co/docs/transformers) version 4.35.0 and later, from any code or client that supports Transformers
|
45 |
- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) - for use from Python code
|
46 |
+
|
47 |
+
## Prompt template: ChatML
|
48 |
+
|
49 |
+
```plaintext
|
50 |
+
<|im_start|>system
|
51 |
+
{system_message}<|im_end|>
|
52 |
+
<|im_start|>user
|
53 |
+
{prompt}<|im_end|>
|
54 |
+
<|im_start|>assistant
|
55 |
+
```
|