darthhexx
/

Meta-Llama-3.1-8B-Instruct-FP8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Model Details

This model is an FP8 quantization of the meta-llama/Meta-Llama-3.1-8B-Instruct model in the safetensors format.

Downloads last month: 56

Safetensors

Model size

8.03B params

Tensor type

BF16

·

F8_E4M3

·

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.