Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Calling word embeddings "models" is a bit misleading. #17

Open
xuf12 opened this issue Apr 3, 2018 · 0 comments
Open

Calling word embeddings "models" is a bit misleading. #17

xuf12 opened this issue Apr 3, 2018 · 0 comments

Comments

@xuf12
Copy link

xuf12 commented Apr 3, 2018

Thanks for putting this together! However, the embedding vectors are just the weights from a shallow NN, which offers far less info than a complete language model (just like the weights from the first layer of training ResNet and ResNet itself). I think we may want to change the title so it doesn't mislead people into believing a word vector is a model...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant