update transformers also for this ?

#1
by talrid - opened

do i must update transformers also for this model ?

currently you state that only https://huggingface.co/ibm-granite/granite-8b-code-instruct needs an updated verison

IBM Granite org

no, only 3 and 8b need an update.
20 and 34b can run with any release version of transformers.
the 3 and 8b should also be fixed with the next transformers release when it comes out.

mayank-mishra changed discussion status to closed

@mayank-mishra
Thanks for the answer.

i was able to load and fine-tune both the 8B and the 34B models (the 8B model indeed needed new versions of transformers and vllm)

I am building a benchmark of fine-tuning models for code tasks. will report results soon

IBM Granite org

sounds great

Sign up or log in to comment