Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TraditionalRLSetting has wrong number of tasks #240

Open
lebrice opened this issue Aug 31, 2021 · 0 comments
Open

TraditionalRLSetting has wrong number of tasks #240

lebrice opened this issue Aug 31, 2021 · 0 comments
Labels
bug Something isn't working

Comments

@lebrice
Copy link
Owner

lebrice commented Aug 31, 2021

setting = TraditionalRLSetting(dataset="MountainCarContinuous-v0", nb_tasks=1)

Will actually alternate between two tasks rather than one during testing. (Need to double-check that this isn't happening during training as well).

This is caused by the task schedule having two keys: one at step 0 (initial conditions) and one that is supposed to only be used in the ContinualRLSetting as the "final conditions", but in this case it is interpreted as the boundary to a second task.

@lebrice lebrice added the bug Something isn't working label Aug 31, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant