Skip to content

Issues: ROCm/flash-attention

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

21 Open 6 Closed
21 Open 6 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Issue]: RuntimeError: FlashAttention forward only supports head dimension at most 128
#51 opened Mar 30, 2024 by xxtars
1
[Issue]: Error in the implementation ?
#50 opened Mar 28, 2024 by PierreColombo
aac.amd: MI210 - roberta-large with sequence length 8192 and batch_size 1 fails
#46 opened Feb 28, 2024 by michaelfeil
[Feature]: Is there a Flash-Decoding algorithm implemented based on Composable kernel? function
#45 opened Feb 28, 2024 by zhangxiao-stack
3
[Issue]: Backward performance
#44 opened Feb 19, 2024 by netw0rkf10w
1
[Issue]: Unstable training
#43 opened Feb 19, 2024 by netw0rkf10w
[Issue]: Installation failed through Dockerfile install
#42 opened Feb 5, 2024 by amdrenwuli
4
[Issue]: RuntimeError: Expected dout_seq_stride == out_seq_stride to be true, but got false.
#41 opened Feb 3, 2024 by donglixp
@howiejayz
11
[Issue]: Expected dout_seq_stride == out_seq_stride to be true, but got false
#40 opened Jan 30, 2024 by ehartford
5
Installation error install
#39 opened Jan 28, 2024 by ekazakos
1
Merge to upstream flash-attention repo upstream
#35 opened Jan 18, 2024 by ehartford
8
Support for other modules (rotary, xentropy, layer_norm) function
#34 opened Jan 15, 2024 by bbartoldson
4
replace kernel implementation using CK tile-programming performant kernels
#33 opened Jan 10, 2024 by carlushuang
4 tasks
@poyenc @carlushuang @danyao12
1
undefined symbol: hipGetDevicePropertiesR0600 navi hardware
#31 opened Jan 2, 2024 by alain40
2
can mask be supported? function
#30 opened Jan 2, 2024 by unwritten
Mi50 Support pre-mi200
#29 opened Dec 31, 2023 by YehowshuaScaled
1
installation error install
#28 opened Dec 9, 2023 by donglixp
13
RDNA3 support navi hardware
#27 opened Dec 5, 2023 by WilliamGazeley
62
MI100 Support pre-mi200
#24 opened Dec 1, 2023 by LoggerHead22
13
Feature request: Sliding Window Attention function
#22 opened Nov 29, 2023 by tjtanaa
6
Install failed install
#20 opened Nov 27, 2023 by 1787648106
11
ProTip! Adding no:label will show everything without a label.