Skip to content

Pull requests: NVIDIA/FasterTransformer

New pull request New
41 Open 128 Closed
41 Open 128 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: fix position_encoding_table memory error.
#791 opened Mar 27, 2024 by johnson-magic Loading…
1
Update README.md
#776 opened Oct 29, 2023 by eltociear Loading…
Fix shape mismatch on the masked_tokens param in decoder masked multi-head attention kernel.
#773 opened Oct 24, 2023 by FengDSP Loading…
Include stdio.h
#770 opened Oct 19, 2023 by JihaoXin Loading…
2
Ft llama opt
#762 opened Oct 2, 2023 by dypshong Loading…
Support Seq length up to 8K
#756 opened Sep 4, 2023 by zhen-jia Loading…
[BugFix] GPT inference error when pipeline_para_size > 1 and int8_mode != 0
#750 opened Aug 23, 2023 by 00why00 Loading…
[Bugfix] GptJ & GptNeoX batch inference error
#742 opened Aug 11, 2023 by YZP17121579 Loading…
1
Add fusion-for-decoder-only for llama
#733 opened Jul 28, 2023 by binxuan Loading…
Fix beam search output_log_prob index error
#732 opened Jul 25, 2023 by cpm0722 Loading…
[Doc] Add projects section in README which is developed based on FasterTransformer
#731 opened Jul 25, 2023 by lvhan028 Loading…
2
Add triton fastertransformer backend support for deberta
#725 opened Jul 19, 2023 by sfc-gh-zhwang Loading…
1
Add cuDNN include path as a common include dir
#724 opened Jul 18, 2023 by jacobkahn Loading…
fix: initialize tiled_prompt_lengths_buf_ to zero in gptneox
#716 opened Jul 13, 2023 by yandai Loading…
Remove parenthesis from asserts
#699 opened Jul 2, 2023 by miguelusque Loading…
Huggingface gptj convert script supports sharded checkpoint
#695 opened Jun 29, 2023 by skyser2003 Loading…
[Doc] Fix typo in gpt_guide.md
#682 opened Jun 26, 2023 by myry96 Loading…
swin-transformer quantization readme files changes
#675 opened Jun 16, 2023 by Mhhhaster Loading…
fix: fix Qk_vec_acum_fp32_ has already been declared
#659 opened Jun 9, 2023 by lkm2835 Loading…
gptneox & gptj int8 quantization & share context
#653 opened Jun 7, 2023 by rahuan Loading…
Add missing headers
#648 opened Jun 1, 2023 by brian14708 Loading…
Fix TOC of gptneox_guide.md
#633 opened May 23, 2023 by xu-song Loading…
Fix for docker image build
#632 opened May 23, 2023 by fredr Loading…
Update gpt_guide.md: documentation link is invalid
#620 opened May 22, 2023 by treycheng Loading…
fix multi-gpu build
#616 opened May 17, 2023 by dskhudia Loading…
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.