Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Can a private/gated dataset be added to a leaderboard?
#170
by
andrejridzik
- opened
Hi guys,
We are currently working on putting together a new benchmark, but some of the underlying datasets can't be made fully public. I would like to know if all datasets need to be made public in order to see the results of corresponding tasks on the leaderboard. Could it work if a gated access is enabled for the dataset?
Thanks a lot for help
Hi @andrejridzik , thanks for the question. I have moved it over to our GitHub as that is where we usually keep our discussions (see also the pinned comment)
Made an issue on it here:
https://github.com/embeddings-benchmark/mteb/discussions/3346