Load failed: 34
#1
by
ceoofcapybaras
- opened
I copy pasted the .pte file to /data/local/tmp/llama/ and also put the tokenizer from llama3 repo, tried multiple builds, how to make it work?
These PTE files are compiled to be used with Layla - the offline assistant: https://www.layla-network.ai/
You can download the Executorch app in Layla and load the model using the RMI (Raw Model Instructions app). Please note this only works on very very high end phones, such as the S23 S24 Ultra.