Config, etc

#3
by Culturedniichan - opened

To run it using llamacpp HF so I can use samplers and other goodies, I need the config, tokenizer, etc. Usually ooba allows to just paste the URL of the unquantized model, but I cannot find the unquantized model. I tried copy pasting the original config files from nemo mistral but it says unrecognized tokenizer. Any idea how to do it?

Eidt: it's probably unrelated. I was also trying to test a grammar and I think the error was coming from there!

Culturedniichan changed discussion status to closed

Sign up or log in to comment