Groupsize is None not 128
If anyone is having issues loading the model please try changing the groupsize from 128 as specified in the instructions to None.
@TheBloke Thank you for all the work, I am planning on subscribing to your Patreon when that comes online!
Argh! Sorry about that. I was putting this together in a rush as I had a bunch of problems, and I forgot to update the README. My READMEs are automated for GGML now, but not for GPTQ, so there's still room for human error there. But I'm working on the process to automate GPTQs right now, so this shouldn't be an issue much longer.
The README is now correct.
You're welcome! My Patreon went live just today actually :) https://patreon.com/TheBlokeAI
Thank you, any support is very much appreciated, and extremely useful.
Thank you I just subscribed!
Thanks so much! I really appreciate it. Do contact me any time if I can help you. And if you'd like to chat, or get live support, my Discord is at https://discord.gg/rSU9f2X3