---
license: llama2
---
EXL2 quants of alpindale/goliath-120b (https://huggingface.co/alpindale/goliath-120b), to be used on exllamav2.

Calibration dataset is wikitext.

[4.85bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/4.85bpw)

[4.5bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/4.5bpw)

[3bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/3bpw)