Skip to content

Pull requests: huggingface/lighteval

New pull request New
32 Open 368 Closed
32 Open 368 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix steps numbers in custom_yourbench_task.py
#643 opened Mar 26, 2025 by alozowski Loading…
1
add arc agi 2
#642 opened Mar 25, 2025 by NathanHB Loading…
2
Rename __initi__.py to __init__.py
#641 opened Mar 25, 2025 by clefourrier Loading…
1
Use blfoat16 as default for vllm models.
#638 opened Mar 24, 2025 by NathanHB Loading…
1
1
[WIP]: better support nanotron
#635 opened Mar 22, 2025 by NouamaneTazi Loading…
1
Lighteval math
#630 opened Mar 20, 2025 by HERIUN Loading…
Add CLI arg generate_until_token to support reasoning and CoT models
#617 opened Mar 17, 2025 by mapmeld Loading…
Add --use-chat-template to the broken litellm example
#614 opened Mar 16, 2025 by eldarkurtic Loading…
2
fix: timedelta import is missing from the lighteval python-api example
#613 opened Mar 14, 2025 by Laz4rz Loading…
2
added vllm lora support.
#611 opened Mar 11, 2025 by haizhou-shi Loading…
Nathan unify modelargs
#609 opened Mar 10, 2025 by NathanHB Loading…
docs: improve consistency in punctuation of metric list
#605 opened Mar 7, 2025 by mariagrandury Loading…
Parse seed for vLLM
#602 opened Mar 4, 2025 by eldarkurtic Loading…
1
Parse string values for add_special_tokens in vLLM
#598 opened Mar 3, 2025 by eldarkurtic Loading…
Add G-Pass@k Metric
#589 opened Feb 26, 2025 by jnanliu Loading…
2
Add draft functionality for a generic sandboxed code running
#580 opened Feb 21, 2025 by plaguss • Draft
1 of 2 tasks
2
Add CodeElo
#575 opened Feb 19, 2025 by plaguss • Draft
1
new metrics and pr-fouras dataset add
#558 opened Feb 13, 2025 by BertrandCabotIDRIS Loading…
4
Adding verbal-reasoning-challenge as a Community Task
#551 opened Feb 11, 2025 by aryawu0513 Loading…
9
Improved stability of litellm models for reasoning models.
#538 opened Feb 5, 2025 by JoelNiklaus Loading…
8
Multi node vLLM
#530 opened Jan 31, 2025 by ncassereau Loading…
16
Update links in readme
#527 opened Jan 30, 2025 by jaysonfrancis Loading…
2
Fix TGI (Text Generation Inference) Endpoint Inference and TGI JSON Grammar Generation
#502 opened Jan 15, 2025 by cpcdoy Loading…
8
Initial proposal for model lazy loading
#497 opened Jan 11, 2025 by JoelNiklaus • Draft
Added diskcache to base model.
#480 opened Dec 30, 2024 by JoelNiklaus Loading…
8
ProTip! Type g i on any issue or pull request to go back to the issue listing page.