Update for correct tool use system prompt
The system prompt implied by the chat template might not be correct, see: https://github.com/meta-llama/llama-agentic-system/issues/36#issuecomment-2274166933
This likely requires updating https://huggingface.co/meta-llama/Meta-Llama-3.1-70B-Instruct and https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct
cc @Rocketknight1 (I think you authored the chat_template?)
Hi @ricklamers , yes I did! We're on it - I'll let you know what decision we come to and if we're going to update the template.
Hi @Rocketknight1 wanted to add an extra request:
Right now, if we enable tool calling by passing the list of tools available, this gets sent to the model as a user message instead of system prompt. Can we please have this added to the system prompt instead?