Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sparse Bilinear map #369

Open
Xparx opened this issue Mar 25, 2024 · 4 comments
Open

Sparse Bilinear map #369

Xparx opened this issue Mar 25, 2024 · 4 comments

Comments

@Xparx
Copy link

Xparx commented Mar 25, 2024

Hey,

I'm trying to implement a custom attention mechanism.
Is there a function or a efficient way to implement a bilinear mapping in pytorch_sparse?

@rusty1s
Copy link
Owner

rusty1s commented Mar 26, 2024

Can you clarify what you wan to do exactly?

@Xparx
Copy link
Author

Xparx commented Mar 26, 2024

I wanted to try to do the same as in the pytorch bilinear module, when A is a sparse matrix.

@Xparx
Copy link
Author

Xparx commented Mar 26, 2024

As far as I understand pytorch_sparse works on 2d tensors so might not be relevant exactly. I might need to think this one over a bit.

@rusty1s
Copy link
Owner

rusty1s commented Mar 27, 2024

torch-sparse can handle more than 2 dimensions (but only the first two can be sparse). Would that be sufficient in your case?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants