cszhzleo
/

Yi-1.5-6B-Chat-nc2-bs1-token1024-neuron-218

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Yi-1.5-6B-Chat-nc2-bs1-token1024-neuron-218 / README.md

cszhzleo's picture

Update README.md

f5c2a7a verified 3 months ago

|

history blame contribute delete

No virus

197 Bytes

metadata

license: apache-2.0

optimum-cli export neuron  --model 01-ai/Yi-1.5-6B-Chat --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16  ./models/01-ai/Yi-1.5-6B-Chat