Skip to content

Pull requests: huggingface/trl

New pull request New
182 Open 3,349 Closed
182 Open 3,349 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: share frozen layers with reference model instead of duplicating in memory
#6053 opened Jun 13, 2026 by behroozazarkhalili Collaborator • Draft
1
Remove issue labeller
#6052 opened Jun 13, 2026 by qgallouedec Member Loading…
chore: update tests_transformers_branch.yml
#6051 opened Jun 13, 2026 by hf-security-analysis Bot Loading…
3
chore: update pr_style_bot.yml
#6050 opened Jun 13, 2026 by hf-security-analysis Bot Loading…
1
chore: update docker-build.yml
#6048 opened Jun 13, 2026 by hf-security-analysis Bot Loading…
1
chore: update clear_cache.yml
#6047 opened Jun 13, 2026 by hf-security-analysis Bot Loading…
1
Remove redundant .contiguous() from the shift logits/labels pattern
#6046 opened Jun 13, 2026 by qgallouedec Member Loading…
1
Remove redundant .contiguous() calls
#6045 opened Jun 13, 2026 by qgallouedec Member Loading…
1
Fix ref adapter creation when the LoRA config uses target_parameters
#6043 opened Jun 13, 2026 by discobot Loading…
4 of 8 tasks
1
3
Warn when sequence-level importance sampling is combined with a token-summed loss type
#6042 opened Jun 13, 2026 by discobot Loading…
4 of 8 tasks
1
2
fix: preserve OnlineDPO vLLM completion ids
#6038 opened Jun 13, 2026 by he-yufeng Loading…
4 of 8 tasks
1
refactor(sft): build labels during dataset preparation instead of collation
#6037 opened Jun 12, 2026 by 0xadvait Loading…
5 of 8 tasks
9
test: don't hard-code bf16=True on devices that lack bf16 support
#6036 opened Jun 12, 2026 by behroozazarkhalili Collaborator Loading…
1
2
fix: load image-text policy for async grpo
#6032 opened Jun 12, 2026 by he-yufeng Loading…
5 of 8 tasks
1
@AmineDiro
fix: pass AsyncGRPO environment rewards
#6031 opened Jun 12, 2026 by he-yufeng Loading…
5 of 8 tasks
1
fix(sft): drop examples with no trainable tokens after max_length truncation
#6025 opened Jun 12, 2026 by 0xadvait • Draft
5 of 8 tasks
1
4
fix(grpo): correct DAPO/CISPO/VESPO loss normalization when steps_per_generation != gradient_accumulation_steps
#6024 opened Jun 12, 2026 by 0xadvait Loading…
5 of 8 tasks
1
Remove silently-ignored W&B/Hub fields from GOLD and Distillation configs
#6023 opened Jun 11, 2026 by DaoyuanLi2816 Contributor Loading…
3 of 4 tasks
Align AsyncGRPO clip-ratio metrics with GRPOTrainer
#6021 opened Jun 11, 2026 by qgallouedec Member Loading…
6
Align AsyncGRPO num_completions_to_print with GRPO (int | None)
#6020 opened Jun 11, 2026 by qgallouedec Member Loading…
1
Align AsyncGRPO epsilon_high with GRPO (None fallback to epsilon)
#6019 opened Jun 11, 2026 by qgallouedec Member Loading…
1
Add experimental Harbor integration for GRPO environment training
#6018 opened Jun 11, 2026 by adithya-s-k Collaborator Loading…
1
8
Fix logging_steps default mentioned in AsyncGRPOConfig docstring
#6016 opened Jun 11, 2026 by qgallouedec Member Loading…
1
Align epsilon help/docstring wording
#6014 opened Jun 11, 2026 by qgallouedec Member Loading…
1
Align async GRPO loss variable names with GRPOTrainer
#6013 opened Jun 11, 2026 by qgallouedec Member Loading…
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.