Freezing of CATS_SCORE and SCORE during training with GPU -0 configuration and fill-config CPU settings #13442
Unanswered
dmesquita
asked this question in
Help: Coding & Implementations
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi everyone!
This is the context:
When using
init fill-config
without specifying thelearn_rate
, it fills in the training settings for CPU (I still need to look into this further, but from what I've seen in the code, I believe this is the case). When training a pipeline with thetextcat
component using--gpu-id -0
and this configuration, no error is generated; however, theCATS_SCORE
andSCORE
remain frozen at eacheval_step
.Initially, I thought about creating a pull request with a way to specify CPU or GPU in the
init-config
command, but it would involve many changes. Then I thought it might be better to check this in thedebug config
and raise the error, but at the validation stage, we still don't know if the user is trying to train using--gpu-id -0
and a CPU configuration.What do you recommend I propose to solve this problem? Actually, before that: is it worth solving this, or is it a rare use case? Thank you!
Beta Was this translation helpful? Give feedback.
All reactions