Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some questions about continuous actions space envs #25

Open
LHDLLL opened this issue Apr 2, 2024 · 2 comments
Open

Some questions about continuous actions space envs #25

LHDLLL opened this issue Apr 2, 2024 · 2 comments

Comments

@LHDLLL
Copy link

LHDLLL commented Apr 2, 2024

Deer author, have you do some tests about continuous actions space envs? Can i let 'continuous=True'? After i use continuous actions space envs to test, it shows that 'action_optimizer.param_groups[0]['params']' no grad. Could you tell me why it occurs?

@hsvgbkhgbv
Copy link
Owner

Hi,

Thank you for your interests. We have never tested the scenarios with continuous actions for this codebase. However, we have tested and implemented SQDDPG in another environment with continuous actions: https://github.com/Future-Power-Networks/MAPDN. You may refer to the implementation of SQDDPG in this codebase, to fit in your own environments.

Hope it would help you!

@LHDLLL
Copy link
Author

LHDLLL commented Apr 2, 2024

Thank you for your answer!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants