error loading model: done_getting_tensors: wrong number of tensors; expected 292, got 291
error loading model: done_getting_tensors: wrong number of tensors; expected 292, got 291
You need to update llama.cpp or the frontend you use to interact with it
same problem here, using OpenWebUI
@raphaelfontes Try to update OpenWebUI. I had the same issue with LM Studio but they released a new version yesterday with an updated llama.cpp that fixed it.
Sadly the backend used in openwebui is ollama, with has not been updated yet, but the original llama3.1 works, but not this one.
@Isaak-Carter
There shouldn't be any problem with the latest ollama v0.3.0 or pre-release v0.3.1.
At least at loading the model correctly.
The model is available here:
https://ollama.com/mannix/llama3.1-8b-abliterated
yeah ok with latest ollama .. but I need llamafile (using llama.cpp)
hope they update soon..they usually do
still facing the same error. wrong number of tensors; expected 292, got 291