File size: 389 Bytes
2d7fc9a cec73e3 b68bef5 2830a89 414d017 2830a89 414d017 |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
license: llama2
---
EXL2 quants of alpindale/goliath-120b (https://huggingface.co/alpindale/goliath-120b), to be used on exllamav2.
Calibration dataset is wikitext.
[4.85bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/4.85bpw)
[4.5bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/4.5bpw)
[3bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/3bpw) |