Hugging Face's logo

Spaces:
ought
/
raft-leaderboard
Running

App Files Community
21

Is there any way to submit and evaluate my model against only one of dataset in RAFT?

#8
by rayjang - opened
Discussion
rayjang

Is there any way to submit and evaluate my model against only one of dataset in RAFT?
I want to check the score of my model only on ONE dataset(ex. banking77 or other one)

lewtun
 Ought org

Hey @rayjang , RAFT isn't designed for single dataset evaluations, but you could always submit your model predictions for banking77 and leave the rest as dummy predictions (e.g. majority class)

Sign up or log in to comment