Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implementation ideas of backpropagation of concat operator #39

Open
owenliang opened this issue Nov 19, 2023 · 3 comments
Open

Implementation ideas of backpropagation of concat operator #39

owenliang opened this issue Nov 19, 2023 · 3 comments

Comments

@owenliang
Copy link

This book is the best deep learning book I have ever seen. With your help, I also wrote a framework with personal characteristics.

At the end of the study of the whole book, I have one more technical detail that I would like to ask you about, which is the frequently used "concat" operator. Its backpropagation involves the reverse splitting of gradient, which I really can't figure out. , can you provide some ideas or add this method to dezero, thank you.

@koki0702
Copy link
Collaborator

Thank you for reading this book.
I would love to think about that question ("concat"), but I'm busy writing my next book right now.

I would like to take some time when I finish writing my next book. Or maybe someone else can help you (I announced it on Twitter).

@laksjdjf
Copy link

I implemented it like this.
https://github.com/laksjdjf/dezero-diffusion/blob/a223c7e2bb06e149ff0a8b0714fcc88fb38b08b7/modules/unet.py#L10-L40

@owenliang
Copy link
Author

I implemented it like this. https://github.com/laksjdjf/dezero-diffusion/blob/a223c7e2bb06e149ff0a8b0714fcc88fb38b08b7/modules/unet.py#L10-L40

3Q,slice helps a lot! Wish this issue also helps others.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants