Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

drop probability #31

Open
cowarder opened this issue Aug 13, 2020 · 5 comments
Open

drop probability #31

cowarder opened this issue Aug 13, 2020 · 5 comments

Comments

@cowarder
Copy link

Did you use dropout while training? I noticed that all of the three models, you set 'dropout_p=0.0', any reason?

@LolBeginner
Copy link

LolBeginner commented Aug 13, 2020 via email

@a-hassanzadeh
Copy link

I have been playing with this model for a while and training models, initially I had it on 0 and now changed it to default value which is 0.3. My model with the custom data introduced overfits after a number of epcohs so changing it to 0.3 has helped.

@cowarder
Copy link
Author

I have overfitting too! I played ResRCNN model with my custom dataset(3 number predict, 5000 videos, 1000 classes). if no pretrained parameter, loss doesn't decrease, if initialized with UCF101 parameter, overfitting enve happen from the first epoch(train loss decrease, val loss increase). Except for dropout prob, did you change any other parameters to relieve overfitting? thanks!

@a-hassanzadeh
Copy link

a-hassanzadeh commented Aug 17, 2020

5000 videos and 1000 classes means 5 videos per class? I wonder if the model is learning anything?
I am working with 2000 videos and 2 classes and the best I can get is 80% accuracy. I think you might be expecting too much from the model.

@shumailaahmed
Copy link

5000 videos and 1000 classes means 5 videos per class? I wonder if the model is learning anything?
I am working with 2000 videos and 2 classes and the best I can get is 80% accuracy. I think you might be expecting too much from the model.

i have a similar setting with 1900 videos and 2 classes, i cant get the validation acc to increase beyond 55%, any suggestions for parameters you have tweaked

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants