Commit
•
4976cc9
1
Parent(s):
6352c06
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,17 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
+
|
| 5 |
+
# Mixtral-6x7B-Instruct-v0.1 (bfloat16)
|
| 6 |
+
|
| 7 |
+
The Mixtral-6x7B-Instruct-v0.1 model is a derivative of the [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) model. It was created by selectively trimming the original model and retaining only the 0th, 2nd, 4th, 5th, 6th, and 7th experts from each layer.
|
| 8 |
+
|
| 9 |
+
The trimming process was facilitated by the [Mixtral-Expert-Trimmer](https://github.com/MeNicefellow/Mixtral-Expert-Trimmer/) tool, developed specifically for this purpose.
|
| 10 |
+
|
| 11 |
+
The model is still in testing phase. It is not clear whether it works.
|
| 12 |
+
|
| 13 |
+
## License
|
| 14 |
+
The Mixtral-6x7B-Instruct-v0.1 model is open-source and licensed under the Apache 2.0 License. For more information, please refer to the LICENSE file.
|
| 15 |
+
|
| 16 |
+
## Feeling Generous? 😊
|
| 17 |
+
Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: [https://ko-fi.com/drnicefellow](https://ko-fi.com/drnicefellow). Please add a note on which one you want me to drink?
|