This release marks the first stable version of MORL-Baselines. After having thoroughly tested the algorithms on various environments fixing bugs for the past few weeks. We feel the library is stable enough to deserve a proper release.
Features
- Over 10 MORL algorithms supported under the MO-Gymnasium API (multi & single policy, under SER and ESR criteria);
- Automated reporting to Weights and Biases dashboards... of various metrics (see screenshot below);
- Clean, documented, and tested code, and this is enforced by our CI hooks;
- Utility functions to help researchers build new algorithms, e.g.
ParetoArchive
,NatureCNN
,PrioritizedReplayBuffer
; - Performances have been tested and reported in a reproducible manner: see #43 and https://wandb.ai/openrlbenchmark/MORL-Baselines.
Example of our dashboards: Pareto front and multi-objective metrics are visible in real-time.