RLLIB+SUMO Utils

Python3 library able to connect the RLLIB framework with the SUMO simulator.

Contact: Lara CODECA [lara.codeca@gmail.com]

This program and the accompanying materials are made available under the terms of the Eclipse Public License 2.0 which is available at http://www.eclipse.org/legal/epl-2.0.

Minimum Requirements

• SUMO 1.5.
• RLLIB RAY 0.8.2

Tested with

• Eclipse SUMO Version 1.9.2
  • With 1.9.2 the options
    • scenario_config['sumo_config']['sumo_connector'] = 'libsumo' with scenario_config['sumo_config']['trace_file'] = True does not work, but the bugh has already been fixed in SUMO issue 8671. If you need to enable SUMO tracing with 1.9.2, you need to use scenario_config['sumo_config']['sumo_connector'] = 'traci'
• RLlib Version 1.3.0

Installation

• Install: pip3 install . from the root directory, or python3 setup.py install
• Development install: pip3 install -e . or python3 setup.py develop

Note: rtree library

To use rtree, libspatialindex-dev is required to be installed.

[In Ubuntu/Debian] sudo apt install libspatialindex-dev python-rtree and then pip install rtree

Example

• Given the under development status of the project, some examples are provided.
  • example/scenario
    • Simple SUMO scenario.
  • example/marlenvironment.py
    • Example of MARL environment implemented using RLLIB (SUMOTestMultiAgentEnv)
  • example/train.py
    • Example of PPO trainer using SUMOTestMultiAgentEnv
    • How to: python3 train.py

Docker Environment

See RLLIB SUMO Docker for details on my development and learning environment.