| pipeline_tag: text-generation | |
| tags: | |
| - Neuron | |
| - Optimum-Neuron | |
| - AWS | |
| Compiled Llama-2-7b-chat-hf using optimum-neuron | |
| ```shell | |
| optimum-cli export neuron --model NousResearch/Llama-2-7b-chat-hf --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/NousResearch/Llama-2-7b-chat-hf | |
| ``` |