Skip to content

Pull requests: NVIDIA/TransformerEngine

New pull request New
33 Open 642 Closed
33 Open 642 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[PyTorch] Store FusedAttention's extra_state to DotProductAttention's extra_state when checkpointing
#917 opened Jun 12, 2024 by cyanguwa Loading…
3 tasks
1
remove code duplication in a test
#915 opened Jun 11, 2024 by rybakov Loading…
3
Add the option to use SM for P2P comm in TP overlap
#914 opened Jun 11, 2024 by erhoo82 Loading…
1 of 11 tasks
3
Fix TE assert weight error
#913 opened Jun 11, 2024 by j316chuck Loading…
3
Fix local cpp tests after inplace build bug Something isn't working
#911 opened Jun 11, 2024 by ksivaman Loading…
8 of 11 tasks
@ksivaman
2
[PyTorch] Expose multi_tensor_* kernels
#907 opened Jun 11, 2024 by yaox12 Loading…
8 of 11 tasks
4
disable using nvfuser when pytorch version >= 2.2
#905 opened Jun 11, 2024 by sudhakarsingh27 Loading…
1 of 4 tasks
3
[Common] Added JIT-compiled fused cast transpose kernels enhancement New feature or request
#903 opened Jun 10, 2024 by Oleg-Goncharov Loading…
6 of 11 tasks
6
[C/PyTorch] Removed MPI dependence in Userbuffers
#901 opened Jun 10, 2024 by denera Loading…
8 of 11 tasks
@denera
3
[JAX] Splitting cpp_extensions.py enhancement New feature or request jax
#899 opened Jun 7, 2024 by phu0ngng Loading…
5 of 11 tasks
4
Add norm_factor arg into DotProductAttention
#897 opened Jun 7, 2024 by BoxiangW Loading…
11 tasks
12
[PyTorch] Refine definition of sliding window size based on attention mask
#895 opened Jun 7, 2024 by cyanguwa Loading…
3 tasks
1
Add documentation for dot product attention
#889 opened Jun 4, 2024 by cyanguwa Loading…
2 of 4 tasks
11
Use unoptimized RMSNorm kernel if pointers are not aligned bug Something isn't working
#886 opened Jun 3, 2024 by timmoon10 Loading…
4 of 11 tasks
2
Fp8 model init factory
#880 opened May 30, 2024 by sudhakarsingh27 • Draft
3
Avoid framework specific import from top level enhancement New feature or request
#862 opened May 22, 2024 by ksivaman • Draft
6 of 11 tasks
@ksivaman
1
[Common/PyTorch] Grouped GEMM via multi-stream cuBLAS
#853 opened May 17, 2024 by yaox12 Loading…
8 of 11 tasks
23
Generation tutorial for Gemma model
#829 opened May 1, 2024 by pggPL Loading…
8 of 11 tasks
34
[Pytorch] Implement fp32 accumulation for attention with context parallel in both forward and backward pass.
#821 opened Apr 28, 2024 by Yuxin-CV Loading…
1
[UB] Adding support for multinode nvlink
#815 opened Apr 26, 2024 by shamisp Loading…
2
Bug fix in DGRAD->RS overlap
#802 opened Apr 23, 2024 by vasunvidia • Draft
[JAX] POC of custom call selection
#797 opened Apr 22, 2024 by zlsh80826 • Draft
3
[PyTorch] Fix minor bug in computing num_gqa_groups_per_partition bug Something isn't working
#777 opened Apr 13, 2024 by knowlsie Loading…
4
[C/PyTorch] Refactor and move userbuffers into TE/common
#760 opened Apr 8, 2024 by denera Loading…
10 of 13 tasks
1
@denera
43
Fix bhss bias format before sm90
#736 opened Mar 27, 2024 by zlsh80826 Loading…
3
ProTip! Filter pull requests by the default branch with base:main.