Compiled Mistral-7B-Instruct-v0.2 using optimum-neuron
optimum-cli export neuron --model mistralai/Mistral-7B-Instruct-v0.2 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/mistralai/Mistral-7B-Instruct-v0.2
- Downloads last month
- 20
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.