Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please give an example to explain how to run this code. #1

Open
WisonHuang opened this issue Sep 23, 2017 · 3 comments
Open

Please give an example to explain how to run this code. #1

WisonHuang opened this issue Sep 23, 2017 · 3 comments

Comments

@WisonHuang
Copy link

No description provided.

@WisonHuang WisonHuang changed the title Please give an example to explain how to run Please give an example to explain how to run this code。 Sep 23, 2017
@WisonHuang WisonHuang changed the title Please give an example to explain how to run this code。 Please give an example to explain how to run this code. Sep 23, 2017
@TropComplique
Copy link
Owner

Hi! This is an unfinished implementation of this paper:
https://arxiv.org/abs/1605.02019

How to run it:

  1. preprocess_data.ipynb
  2. get_windows.ipynb
  3. train.ipynb - but the gradient for some reason explodes.
    I hope, next week I will fix this implementation.

@qiaochen
Copy link

qiaochen commented Sep 29, 2017

Hi Антощенко,

Thanks for your effort to implement LDA2vec with pytorch. You might have noticed the gradient issue that results in the halt of total losses during training. I'm really curious about the cause of the issue, would you please also inform me of the details of the problem after fixing it?
Thanks and good luck!

@TropComplique
Copy link
Owner

The cause of the issue was logarithm function.
I fixed the problem by changing log(x) to log(x + epsilon) where epsilon is small.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants