q4?
#1
by
Debich
- opened
Hello. Is it possible to make q4? I can't run q4 k s, q4 k m and q4 m l. The largest model I can run in this case is the regular q4. Or at least q3 k l if you actually have the ability to do so.
I already deleted the f16.gguf and the raw model files from my PC, so it's kind of hard for me to make new quants now. Sorry :(
gbueno86
locked this discussion
gbueno86
unlocked this discussion