Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
COIR Dataset integrate to MTEB
#138
by
yliu279
- opened
Hi @tomaarsen @Muennighoff ,
I noticed that the Code Information Retrieval (COIR) benchmark has been integrated into the MTEB GitHub library in this PR. https://github.com/embeddings-benchmark/mteb/pull/1159
I’m curious, do we have an estimated timeline for when this leaderboard will be available on our MTEB tag?
Thanks,
Ye
Thanks for the note & looking forward to see the performance of your model! If you want, you can open a PR here to add a new tab for the benchmark to the leaderboard: https://github.com/embeddings-benchmark/leaderboard & then it will be available after the next sync! 😊 // @tomaarsen feel free to do it if you want! :)
Added a preliminary tab for it but not a lot of results yet :)