Skip to content

Pull requests: pytorch/torchtitan

New pull request New
18 Open 253 Closed
18 Open 253 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Update pipelining import after change on pytorch
CLA Signed This label is managed by the Meta Open Source bot.
#356 opened May 23, 2024 by wconstab Loading…
[torchtitan][optim] Add fused as an option in train config
CLA Signed This label is managed by the Meta Open Source bot.
#355 opened May 22, 2024 by wz337 Loading…
3
use local_map to annotate fusedrmsnorm
CLA Signed This label is managed by the Meta Open Source bot.
#346 opened May 18, 2024 by wanchaol • Draft
Add a 3-stage PP config
CLA Signed This label is managed by the Meta Open Source bot.
#345 opened May 18, 2024 by wconstab Loading…
Add 3D support
CLA Signed This label is managed by the Meta Open Source bot.
#344 opened May 17, 2024 by wconstab Loading…
only produce tensorboard logs on rank 0 by default
CLA Signed This label is managed by the Meta Open Source bot.
#339 opened May 16, 2024 by tianyu-l Loading…
1
1
selective compilation - norm layers only
CLA Signed This label is managed by the Meta Open Source bot.
#320 opened May 10, 2024 by lessw2020 Loading…
18
Add support of DDP and CompiledAutograd.
CLA Signed This label is managed by the Meta Open Source bot.
#319 opened May 9, 2024 by fegin Loading…
6
[fused_rmsnorm] Register as a custom operator for tracing
CLA Signed This label is managed by the Meta Open Source bot.
#303 opened May 3, 2024 by wconstab Loading…
13
[fused_rmsnorm] Avoid querying device inside forward
CLA Signed This label is managed by the Meta Open Source bot.
#301 opened May 3, 2024 by wconstab Loading…
[fused_rmsnorm] Avoid conditional on dynamic stride
CLA Signed This label is managed by the Meta Open Source bot.
#300 opened May 3, 2024 by wconstab Loading…
3
register fused rmsnorm as pytorch custom op
CLA Signed This label is managed by the Meta Open Source bot.
#296 opened May 2, 2024 by tianyu-l • Draft
[wip] differentiate Rstd vs rstd
CLA Signed This label is managed by the Meta Open Source bot.
#294 opened May 2, 2024 by lessw2020 Loading…
RFC for ckpt apis
CLA Signed This label is managed by the Meta Open Source bot.
#226 opened Apr 13, 2024 by wconstab Loading…
9
[RFC] Sharded embeddings in separate FSDP group
CLA Signed This label is managed by the Meta Open Source bot.
#182 opened Apr 1, 2024 by awgu • Draft
run sdpa with dtensor
CLA Signed This label is managed by the Meta Open Source bot.
#180 opened Mar 30, 2024 by tianyu-l Loading…
5
[Draft] PP tracing works
CLA Signed This label is managed by the Meta Open Source bot.
#155 opened Mar 20, 2024 by kwen2501 • Draft
Implement fast checkpoint path
CLA Signed This label is managed by the Meta Open Source bot.
#127 opened Mar 12, 2024 by fegin Loading…
2
ProTip! Type g i on any issue or pull request to go back to the issue listing page.