Skip to content

Pull requests: mlfoundations/evalchemy

New pull request New
6 Open 72 Closed
6 Open 72 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Support for Big Bench Extra Hard (General-purpose reasoning eval)
#92 opened Mar 8, 2025 by Hritikbansal Loading…
Add the ability to do inference externally to Evalchemy
#91 opened Mar 6, 2025 by RyanMarten Loading…
OpenAI API key handling and task loading in evaluation framework
#88 opened Mar 4, 2025 by jmercat Loading…
Adding Arena Hard Auto
#65 opened Jan 28, 2025 by asuvarna31 Loading…
4
Dependency conflicts
#44 opened Dec 20, 2024 by penfever Loading…
2
Multi-node
#29 opened Nov 22, 2024 by jmercat Loading…
2
ProTip! no:milestone will show everything without a milestone.