implement simplified transformer (He 2023) #2475
AwokeKnowing
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Given a key goal of this project is minimal representation of code for transformers, I suggest effort be made to investigate if the simplified transformer would result in significantly simplified code:
https://twitter.com/rasbt/status/1729123424990068743
Beta Was this translation helpful? Give feedback.
All reactions