Model Failed: StableProse

#894
by nlpguy - opened
Open LLM Leaderboard org

Hi @nlpguy ,

I've resubmitted your model, it should be fine now.

I will close this issue, please, ping me here if you need any help with this model again or open a new discussion

alozowski changed discussion status to closed

Hi @alozowski , sorry to say the model failed again. I really don't want to waste everybodys compute here, so could you maybe find out why it failed? If it is a issue on my side I don't want to resubmit it, as it will just fail again, but failures rates have gone up dramatically after the new leaderboard has been running for a while now, so maybe you can do something?

alozowski changed discussion status to open
Open LLM Leaderboard org

Hi @nlpguy !

No worries, I've resubmitted your model. Unfortunately, it was a network issue but it should be fine now.

I wouldn't say there are more failures rates with v2 update as I monitor them all. Our backend system hasn't changed, but indeed, sometimes there can be unexpected situations, we try to solve them as quickly as possible. If you see any problems with your models, feel free to open a discussion, we are always here to help!

alozowski changed discussion status to closed

Sign up or log in to comment