Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The test accuracy is pretty low (53.5%) for citeseer dataset #58

Open
erichanxin opened this issue Apr 17, 2021 · 4 comments
Open

The test accuracy is pretty low (53.5%) for citeseer dataset #58

erichanxin opened this issue Apr 17, 2021 · 4 comments

Comments

@erichanxin
Copy link

I switched the dataset to citeseer, and trained for 100 epochs, the 99th epoch training log is:
Epoch: 0099 loss_train: 0.9922 acc_train: 0.7000 loss_val: 1.0769 acc_val: 0.7100 time: 38.2587s

However, the finial test result is:
Test set results: loss= 1.2956 accuracy= 0.5350

The accuracy is pretty low, not like the 72% shown in the paper

@SuperBruceJia
Copy link

I switched the dataset to citeseer, and trained for 100 epochs, the 99th epoch training log is:
Epoch: 0099 loss_train: 0.9922 acc_train: 0.7000 loss_val: 1.0769 acc_val: 0.7100 time: 38.2587s

However, the finial test result is:
Test set results: loss= 1.2956 accuracy= 0.5350

The accuracy is pretty low, not like the 72% shown in the paper

Have you solved the problem?

@MichailChatzianastasis
Copy link

Is there any update on this issue? I also obtain low performance on citeseer.

@erichanxin
Copy link
Author

Actually NO! I cannot find any method to solve this problem.

@LQchen1
Copy link

LQchen1 commented Sep 21, 2022

Based on your epoch log, it looks like the model is overfitting, maybe try changing the dropout parameter

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants