Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Torch dependency issues #72

Open
davidmezzetti opened this issue Jun 3, 2020 · 1 comment
Open

Torch dependency issues #72

davidmezzetti opened this issue Jun 3, 2020 · 1 comment

Comments

@davidmezzetti
Copy link

Thank you for this package, it's a great idea and still very useful for those using Word2vec/GloVe/fastText. The performance gains from having vectors in SQLite and not having to pin the entire model into memory is great.

Currently, torch 0.4.1 is being installed regardless if torch is already installed and it's overriding much newer versions of torch causing environment issues.

The project would be much simpler by at least making ELMo optional (mentioned in #59) or even removing support. As an example, I have created a fork of Magnitude doing that. Removing ELMo support allows removing most third party dependences as 999 columns works for everything but ELMo. Build times on pip install goes from 5+ minutes to seconds on my local machine.

You can make the argument that if you'd like more complex embeddings, looking towards Transformer models is a better approach than ELMo. But there still are use cases for simple word embeddings and keeping this library simple to maintain/update would be great.

@riven314
Copy link

riven314 commented Jul 25, 2020

As a remark to the torch dependency matter, it caused an issue to my conda environment.
I realized this setting when I found that my torch cuda was suddenly disabled
I later found that it was caused by my torch being replaced by 0.4.1.post2 during pymagnitude installation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants