Skip to content

Pull requests: pytorch/torchtune

New pull request New
85 Open 1,473 Closed
85 Open 1,473 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

nested instantiation CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2519 opened Mar 19, 2025 by felipemello1 • Draft
1 of 4 tasks
4
(WIP) Enable instantiation from globals CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2518 opened Mar 19, 2025 by felipemello1 • Draft
1 of 4 tasks
2
[WIP] System Prompt Mapping for Instruct DS CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2514 opened Mar 18, 2025 by jaysonfrancis • Draft
1 of 13 tasks
5
Adding EOS Tokens to Qwen Models CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2512 opened Mar 18, 2025 by ariG23498
1
1
Fix recursive_reshard utility CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2510 opened Mar 18, 2025 by ebsmothers • Draft
1
1
Linear Cross Entropy CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2507 opened Mar 17, 2025 by Andrei-Aksionov • Draft
1 of 13 tasks
10
Tiny model docs nits CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2506 opened Mar 17, 2025 by SalmanMohammadi
1
Hacky changes to finish enabling 2D parallel CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2503 opened Mar 14, 2025 by ebsmothers • Draft
4
Use DCP in HFCheckpointer to read/write directly to HuggingFace CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2494 opened Mar 13, 2025 by ankitageorge Loading…
4 tasks
1
[WIP] Gemma3 support. CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2485 opened Mar 12, 2025 by krammnic Loading…
4 of 13 tasks
5
Regression testing in torchtune. CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2477 opened Mar 11, 2025 by krammnic Loading…
2 of 13 tasks
7
GRPO LoRA Single Device CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2467 opened Mar 9, 2025 by ianbarber Loading…
1 of 9 tasks
1
Only offload if activation is on CUDA CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2466 opened Mar 6, 2025 by janeyx99 Loading…
3 of 13 tasks
2
Reference-free DPO losses in torchtune. CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2465 opened Mar 6, 2025 by krammnic Loading…
3 of 13 tasks
2
Add validation dataset loss to distributed SFT recipies CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2464 opened Mar 6, 2025 by bzz Loading…
5 of 13 tasks
@felipemello1
12
[WIP][RFC] Refactored and Simplified Recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2447 opened Feb 28, 2025 by pbontrager • Draft
13
Enable PPO on Intel XPU using a tiny model CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2446 opened Feb 27, 2025 by songhappy Loading…
3 tasks done
7
[WIP] Add StatefulDataLoader to all recipes except knowledge_single CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2441 opened Feb 26, 2025 by krammnic Loading…
2 of 13 tasks
10
Scale grads by dp size rather than world size CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2440 opened Feb 26, 2025 by joecummings • Draft
13 tasks
1
[WIP] Add Llama3.3 tokenizer & replace 'ipython' role with 'tool' CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2438 opened Feb 26, 2025 by Ankur-singh • Draft
6 of 13 tasks
3
Bugfixes: Grad norm scaling in TP CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2436 opened Feb 25, 2025 by nathan-az • Draft
1 of 13 tasks
1
Rough draft for integration with DCP HF Storage Reader / Writer CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2435 opened Feb 25, 2025 by joecummings • Draft
1
[WIP] Padding bug in GRPO CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2425 opened Feb 22, 2025 by krammnic Loading…
2 of 13 tasks
2
[RFC] Proposal to Update PPO Test to Add LR Scheduler CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2423 opened Feb 22, 2025 by Seoley Loading…
6 of 13 tasks
9
GRPO datasets CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2422 opened Feb 22, 2025 by krammnic Loading…
2
ProTip! Mix and match filters to narrow down what you’re looking for.