Skip to content
This repository has been archived by the owner on May 19, 2021. It is now read-only.

Preprocessing Data from Observations #23

Open
max-schenke opened this issue Jul 24, 2020 · 0 comments
Open

Preprocessing Data from Observations #23

max-schenke opened this issue Jul 24, 2020 · 0 comments

Comments

@max-schenke
Copy link

Hello,

is there a way to implement a custom preprocessing / featurizing routine into the training process?
Is such a feature already available?

I am currently making use of a featurizer to preprocess the observations from the environment.
As I haven't found a way to implement it into the agent, I had to define this preprocessor as a part of the environment.
Unfortunately, the preprocessor transforms the low-dimensional environment state into a high-dimensional feature vector,
which is then appended to the memory buffer.
Consequently, the training uses a huge amount of RAM, although it should be possible to perform the preprocessing just in time, directly after low-dimensional observations have been loaded from the memory.

Thank you.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant