File size: 370 Bytes
7e21452 0e46cb0 7e21452 a9769ff 7e21452 a9769ff 7e21452 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
pipeline_tag: text-generation
tags:
- Neuron
- Optimum-Neuron
- AWS
- optimum-neuron==0.0.21
---
Compiled lmsys/vicuna-7b-v1.5 using optimum-neuron (optimum-neuron==0.0.21 neuron with 2.18.2)
```shell
optimum-cli export neuron --model lmsys/vicuna-7b-v1.5 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/lmsys/vicuna-7b-v1.5
|