Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ek826
/
Meta-Llama-3.1-405B-Instruct-4.5bpw-gqa-exl2
like
0
Text Generation
Transformers
Safetensors
PyTorch
8 languages
llama
facebook
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
exl2
arxiv:
2204.05149
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Meta-Llama-3.1-405B-Instruct-4.5bpw-gqa-exl2
/
tokenizer.json
ek826
new 4.5bpw with 8 heads gqa
85731ee
verified
about 1 month ago
raw
Copy download link
history
contribute
delete
No virus
9.09 MB
File too large to display, you can
check the raw version
instead.