You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Can we add a new column to the Big Code Leaderboard which describes the exact command line to reproduce the scores?
I saw many similar questions asking about how to reproduce the scores, and the differences against the paper.
This new column will definitely help.
Thanks!
The text was updated successfully, but these errors were encountered:
Hi, I just saw this issue, but does the only variable is the model_name here to reproduce results? And if that is the case, do we require a whole column?
Wonderful Bigcode collaborators,
Can we add a new column to the Big Code Leaderboard which describes the exact command line to reproduce the scores?
I saw many similar questions asking about how to reproduce the scores, and the differences against the paper.
This new column will definitely help.
Thanks!
The text was updated successfully, but these errors were encountered: