cszhzleo
/

Mistral-7B-Instruct-v0.2-nc2-bs1-token1024-neuron-218

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

cszhzleo commited on Apr 23

Commit

b5ca200

•

1 Parent(s): e761308

Update README.md

Files changed (1) hide show

README.md +9 -0

README.md CHANGED Viewed

@@ -1,5 +1,14 @@
 ```
 optimum-cli export neuron  --model mistralai/Mistral-7B-Instruct-v0.2 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16  ./models/mistralai/Mistral-7B-Instruct-v0.2
 ```

+---
+pipeline_tag: text-generation
+tags:
+- Neuron
+- Optimum-Neuron
+- AWS
+---
+Compiled Mistral-7B-Instruct-v0.2 using optimum-neuron
 ```
 optimum-cli export neuron  --model mistralai/Mistral-7B-Instruct-v0.2 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16  ./models/mistralai/Mistral-7B-Instruct-v0.2
 ```