Skip to content

Pull requests: facebookresearch/fairscale

New pull request New
27 Open 796 Closed
27 Open 796 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Llama4 FP8 Training Debug - fairscale
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1183 opened May 7, 2024 by jiecaoyu Loading…
10 tasks
Fix minor grammatical corrections in docs
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1181 opened Apr 29, 2024 by aakashapoorv Loading…
6 of 10 tasks
[WIP] Make FSDPv1 only perform cat() during last microbatch backward() within FlattenParamsWrapper
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1180 opened Apr 29, 2024 by chrisxcai • Draft
[WIP] Make FSDPv1 only perform cat() during last microbatch backward() within FlattenParamsWrapper
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1178 opened Apr 19, 2024 by chrisxcai • Draft
1
Make sure that tensor is contiguous before gathering across processes
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1173 opened Apr 1, 2024 by patrickvonplaten Loading…
Bump black from 22.3.0 to 24.3.0
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. dependencies Pull requests that update a dependency file
#1169 opened Mar 20, 2024 by dependabot bot Loading…
Fairscale support for only performing allreduce in last microbatch
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1168 opened Mar 18, 2024 by jiecaoyu • Draft
10 tasks
3
Fix params_with_grad in FSDP when the model has frozen parameters
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1167 opened Mar 4, 2024 by whbldhwj Loading…
1 of 10 tasks
Avoid calling _free_fp16_param_shard() too early
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1164 opened Feb 20, 2024 by jiecaoyu Loading…
10 tasks
3
ci: Use GITHUB_OUTPUT envvar instead of set-output command
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1160 opened Jan 18, 2024 by arunsathiya Loading…
1
Added reshard hook for frozen params in backward
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1159 opened Jan 12, 2024 by awgu Loading…
1 of 10 tasks
6
Add support for torch.set_default_device when initializing model parameters
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1158 opened Dec 28, 2023 by fshp971 Loading…
6 of 10 tasks
Fix _free_full_params()
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1149 opened Nov 21, 2023 by hadasah Loading…
10 tasks
Extend CheckpointFunction to track all tensor input/output
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1148 opened Nov 7, 2023 by 000Justin000 Loading…
6 of 10 tasks
[Not for merge] fp8allgather debug
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1147 opened Oct 29, 2023 by jiecaoyu Loading…
Add main grad before fwd pass
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1142 opened Oct 4, 2023 by vedanuj • Draft
10
Add main_grad
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1140 opened Oct 2, 2023 by jianyuh Loading…
10 tasks
6
Fp8 all gather hack
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1136 opened Sep 17, 2023 by jspark1105 Loading…
5
Fix typo in ParallelEmbedding argument assignment
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1132 opened Aug 28, 2023 by hessamb Loading…
4
Add a context manager for activation sharding.
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1127 opened Jun 12, 2023 by luyug Loading…
1
added option to do backward AG over smaller set of gpus instead of full DDP world
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1125 opened May 20, 2023 by ngoyal2707 Loading…
5
Update oss_sdp_fsdp.rst
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1122 opened Apr 21, 2023 by wenjun93 Loading…
10 tasks
1
8 bit all_gather CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1105 opened Feb 14, 2023 by ngoyal2707 Loading…
4
Fsdp ptd CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1085 opened Sep 27, 2022 by ruanslv • Draft
3
[FSDP] fix for high GPU reserved memory (v2) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1052 opened Aug 3, 2022 by ruanslv Loading…
7
ProTip! What’s not been updated in a month: updated:<2024-04-11.