Skip to content

Pull requests: huggingface/trl

New pull request New
43 Open 1,167 Closed
43 Open 1,167 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add xpu support for DPO
#2533 opened Dec 30, 2024 by faaany • Draft
5 tasks
PPOTrainer: fix progress bar for num_mini_batches > 1
#2531 opened Dec 29, 2024 by dawidm Loading…
4 tasks done
1
Include stop token in policy model's generation_config
#2528 opened Dec 28, 2024 by dawidm Loading…
2 of 5 tasks
1
[ORPO] revert orpo changes
#2527 opened Dec 28, 2024 by kashif Loading…
@kashif
1
check for model instantiation added
#2522 opened Dec 27, 2024 by shirinyamani Loading…
5 tasks
fixed sft trainer docs
#2521 opened Dec 26, 2024 by umbilnm Loading…
4 tasks
2
🕊️ DPO padding free
#2520 opened Dec 26, 2024 by qgallouedec Loading…
5 tasks
3
RLOO trainer: fix calculations of steps, episodes and epochs
#2516 opened Dec 23, 2024 by dawidm Loading…
KTO refactor
#2507 opened Dec 20, 2024 by qgallouedec • Draft
5 tasks
1
[WIP] Integrate Liger CPO & SimPO
#2506 opened Dec 20, 2024 by Mecoli1219 • Draft
1 of 6 tasks
1
🚜 Use field in dataclasses
#2494 opened Dec 17, 2024 by qgallouedec Loading…
1
adding readme for datasets
#2491 opened Dec 16, 2024 by August-murr Loading…
5 tasks
1
@August-murr
5
[Liger] add native liger-kernel orpo loss
#2482 opened Dec 15, 2024 by kashif Loading…
18
Tool fine-tuning support DPO
#2479 opened Dec 14, 2024 by August-murr Loading…
4 of 5 tasks
@August-murr
6
Allow eval in Online DPO
#2476 opened Dec 13, 2024 by qgallouedec • Draft
5 tasks
2
1
dpo_trainer gather metrics across ranks before logging
#2474 opened Dec 13, 2024 by zhc7 Loading…
2 of 5 tasks
1
5
Add length-normalized DPO
#2458 opened Dec 10, 2024 by hugoabonizio Loading…
1 of 5 tasks
1
Padding free dpo
#2437 opened Dec 4, 2024 by dame-cell Loading…
2 of 5 tasks
1
34
[Reward] initial CLoud Reward trainer
#2432 opened Dec 3, 2024 by kashif Loading…
4
added eos token for ppotrainer
#2420 opened Nov 30, 2024 by dame-cell Loading…
3 of 5 tasks
1
2
🔬 SFT simplification
#2405 opened Nov 28, 2024 by qgallouedec Loading…
5 tasks
4
🧪 [Experimental] Train LeRobot policy with TRL
#2359 opened Nov 15, 2024 by qgallouedec • Draft
5 tasks
1
👩‍🏫 Add SFT notebook for chatbot development
#2321 opened Nov 4, 2024 by qgallouedec • Draft
5 tasks
1
[Draft] Add eval_data_collator arg
#2311 opened Nov 3, 2024 by pdufour • Draft
1 of 5 tasks
1
[Draft] Add autocast to prediction_step for SFTTrainer
#2310 opened Nov 3, 2024 by pdufour • Draft
2 of 5 tasks
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.