Skip to content
This repository has been archived by the owner on Dec 28, 2023. It is now read-only.

Example code doesn't converge #15

Open
Omegastick opened this issue Oct 18, 2019 · 1 comment
Open

Example code doesn't converge #15

Omegastick opened this issue Oct 18, 2019 · 1 comment
Labels
bug Something isn't working

Comments

@Omegastick
Copy link
Owner

Some time around ae03039 we regressed and the example code in gym_client.cpp doesn't converge any more. Presumably because of some difference in our observation normalization compared to the OpenAI Baselines one.

I'll look in more detail this weekend and confirm if it's that exact commit causing the problem.
@Omegastick Omegastick added the bug Something isn't working label Oct 18, 2019
@Omegastick Omegastick mentioned this issue Oct 18, 2019
Closed
@Omegastick
Copy link
Owner Author

After fixing #14, it converges, but I feel like it used to converge faster. I'll run some more detailed comparisons when I get time.

FPS has dropped about 20% on my laptop since the first release, but that could be a lot of things.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Omegastick