Hugging Face's logo

Spaces:
open-llm-leaderboard
/
open_llm_leaderboard
Running on CPU Upgrade

App Files Community
938

model evaluation failed

#929
by FuJhen - opened
Discussion
FuJhen
•
edited 6 days ago

Hello team,

I getting failed error,

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/FuJhen/ft-openhermes-25-mistral-7b-irca-dpo-pairs_eval_request_False_bfloat16_Adapter.json

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/FuJhen/mistral-instruct-7B-DPO_eval_request_False_bfloat16_Adapter.json

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/FuJhen/mistral_7b_v0.1_structedData_viggo_eval_request_False_bfloat16_Adapter.json

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/FuJhen/mistral_7b_v0.1_structedData_e2e_eval_request_False_bfloat16_Adapter.json

What is the status?
Could you please reveal the failing reason or resubmit it?

Thanks.

alozowski
 Open LLM Leaderboard org

Hi @FuJhen ,

Thank you for this discussion as I've been closely monitoring the evaluation of adapter models in recent weeks to make sure they run smoothly.

You can find your first two models on the Leaderboard now, please, checkout my screenshot. For the second two I've resubmitted them and we can expect the results in a couple of days. Please, feel free to ping me here if they fail again, but I hope the evaluation will be fine.

Screenshot 2024-09-17 at 12.20.55.png

alozowski changed discussion status to closed
alozowski
 Open LLM Leaderboard org

UPD: you can find all your models on the Leaderboard now! 🤗

Sign up or log in to comment