| license: llama2 | |
| EXL2 quants of alpindale/goliath-120b (https://huggingface.co/alpindale/goliath-120b), to be used on exllamav2. | |
| Calibration dataset is wikitext. | |
| [4.85bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/4.85bpw) | |
| [4.5bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/4.5bpw) | |
| [3bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/3bpw) |