New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Some issues when combining deep_architect
and ray.tune
#8
Comments
Hey there - this seems like a problem with Ray's documentation being unclear. What if you just did:
|
Hi Iacopo. Apologies for the delay. Unfortunately, I haven't been able to dedicate much time to the DeepArchitect lately, but I'm looking to resume soon. I'm curious about whether how far did you go with DeepArchitect in your work. I'm not familiar with Ray but happy to integrate some functionality as it seems widely adopted now. I don't see any inherent problems in using DeepArchitect with Ray, provided that Ray does not need too much information about the workload that it is running (e.g., the exact architecture). |
Hi @negrinho No need to apologize :-) didn't have much time to work on this either. The idea would be to be able to use DeepArchitect functions as a sampler for a Pytorch (or TF) model in the I will have a person working on a closely related project starting in October, so I will hopefully be able to give more detailed information soon. |
Your example is pretty clear. Thanks for sharing. This is something that I would be interested in including in the repo (at the very least, an example). I'm curious about how the ongoing project is doing and if there are questions that I would be able to help with. I would be happy to help in whatever way I can.
|
Hi, first of all, I'd like to thank you for building and releasing
deep_architect
.I am opening this issue because I'd like to use
deep_architect
together withray.tune
to get the best of both worlds, but I encountered some issues. Feel free to close this if you think it is out of the scope of the project.My goal is to use the sampling capabilities of
deep_architect
and the tools for multiprocessing and logging ofray
andray.tune
. Therefore I'm usingtune.run
andtune.Trainable
with thesearchers
,helpers
andmodules
ofdeep_architect
.If I write my code with the call to the sampling function inside the
_setup
method of atune.Trainable
https://gist.github.com/iacolippo/1262c8afbfd9f5e491add5fbae105afa (line 124)
then I have an issue with
ray(tensorboard)
logging. I'd say this is not an issue ofdeep_architect
, and it shouldn't be too hard to fix in the source code of ray if need be.If I write my code as
ray
wants it (theconfig["model"]
is the model object, in this case, aPytorchModel
fromdeep_architect
), then I have a different error.https://gist.github.com/iacolippo/3f815fa90c254f7a065bdc446406233a (not that the
()
disappeared at line 124)This might be an issue with
deep_architect
and multiprocessing, or Pytorch itself, I don't know, I didn't dig into it too much for lack of time. Here is the traceback.traceback.log
I am using
Stay safe!
The text was updated successfully, but these errors were encountered: