Code snippet, yaml

README.md

@@ -1,3 +1,11 @@
+---
+pipeline_tag: text-generation
+inference: false
+tags:
+- mistral
+- mlx
+---
+
 # Mistral-7B-v0.1
 
 The Mistral-7B-v0.1 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters. 
@@ -5,9 +13,21 @@ Mistral-7B-v0.1 outperforms Llama 2 13B on all benchmarks we tested.
 
 For full details of this model please read our [paper](https://arxiv.org/abs/2310.06825) and [release blog post](https://mistral.ai/news/announcing-mistral-7b/).
 
-## Model Architecture
+This repository contains the `mistral-7B-v0.1` weights in `npz` format suitable for use with Apple's MLX framework.
+
+## Use with MLX
+
+```bash
+pip install mlx
+pip install huggingface_hub hf_transfer
+git clone https://github.com/ml-explore/mlx-examples.git
+
+# Download model
+export HF_HUB_ENABLE_HF_TRANSFER=1
+huggingface-cli download --local-dir-use-symlinks False --local-dir mistral-7B-v0.1 mlx-community/mistral-7B-v0.1
+
+# Run example
+python mlx-examples/mistral/mistral.py --prompt "My name is" --model_path mistral-7B-v0.1
+```
 
-Mistral-7B-v0.1 is a transformer model, with the following architecture choices:
-- Grouped-Query Attention
-- Sliding-Window Attention
-- Byte-fallback BPE tokenizer
+Please, refer to the [original model card](https://huggingface.co/mistralai/Mistral-7B-v0.1) for more details on Mistral-7B-v0.1.