{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":643495755,"defaultBranch":"master","name":"xuance","ownerLogin":"agi-brain","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-05-21T10:55:10.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/134463324?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1717382538.0","currentOid":""},"activityList":{"items":[{"before":"0f0e931524f58d81b12cd75dc6be2ae4b57fe961","after":"c6bb68397d86ddeda34e2214b2fae392f0384a35","ref":"refs/heads/master","pushedAt":"2024-06-04T05:50:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"subprocessing envs","shortMessageHtmlLink":"subprocessing envs"}},{"before":"22ae32427c7b26653961d68096c47434bae061b9","after":"0f0e931524f58d81b12cd75dc6be2ae4b57fe961","ref":"refs/heads/master","pushedAt":"2024-06-04T02:28:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"max_episode_steps","shortMessageHtmlLink":"max_episode_steps"}},{"before":"63acf0d680de0e1efdb1cd69376bb063a42e9cc6","after":"22ae32427c7b26653961d68096c47434bae061b9","ref":"refs/heads/master","pushedAt":"2024-06-03T14:57:21.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"single-agent DRL test","shortMessageHtmlLink":"single-agent DRL test"}},{"before":"d7d31a94b1051e9957932f933bc14e0fc99efb2c","after":"63acf0d680de0e1efdb1cd69376bb063a42e9cc6","ref":"refs/heads/master","pushedAt":"2024-06-03T09:51:05.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"update apis","shortMessageHtmlLink":"update apis"}},{"before":"d15d1f8a26dce852d0c45820273c9e06b3cae209","after":"d7d31a94b1051e9957932f933bc14e0fc99efb2c","ref":"refs/heads/master","pushedAt":"2024-06-03T07:42:47.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"APIs: policies","shortMessageHtmlLink":"APIs: policies"}},{"before":"8756dbefb23519e0c95343effceb45de3c1b5d66","after":null,"ref":"refs/heads/environment","pushedAt":"2024-06-03T02:42:18.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"}},{"before":"6cb327b432236d6a494796b75fdc8989f762fad3","after":"d15d1f8a26dce852d0c45820273c9e06b3cae209","ref":"refs/heads/master","pushedAt":"2024-06-02T15:40:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"make environment","shortMessageHtmlLink":"make environment"}},{"before":"8036104eadcf8c267e8ecc93c0c484267e02fb82","after":"6cb327b432236d6a494796b75fdc8989f762fad3","ref":"refs/heads/master","pushedAt":"2024-06-02T15:37:56.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"created for 1.2.x (#40)\n\n* add utils for basic environment\r\n\r\n* environment wrapper\r\n\r\n* MountainCar\r\n\r\n* unified environment for single agent\r\n\r\n* unified marl environments\r\n\r\n* unified vector environment\r\n\r\n* DummyVecEnv\r\n\r\n* DummyVecEnv\r\n\r\n* unified envrionments\r\n\r\n* unified multi-agent envrionments\r\n\r\n* reformate mpe\r\n\r\n* unified environment for iddpg+mpe\r\n\r\n* unified marl environments for iddpg\r\n\r\n* unified marl environments for iddpg\r\n\r\n* unified marl environments for iddpg\r\n\r\n* unified marl environments\r\n\r\n* unified agents maddpg\r\n\r\n* iddpg not parameter sharing\r\n\r\n* iddpg not parameter sharing\r\n\r\n* unified maddpg: share parameters or not\r\n\r\n* matd3 use prametersharing or not\r\n\r\n* model_keys\r\n\r\n* deterministic policy comments\r\n\r\n* normalize\r\n\r\n* iql use parametersharing or not\r\n\r\n* iql unified\r\n\r\n* memory for marl unified\r\n\r\n* use one memory for parameter sharing or not\r\n\r\n* update memory for iddpg by combine use_parameter_sharing\r\n\r\n* update memory for both parameter sharing or not\r\n\r\n* update memory\r\n\r\n* iql\r\n\r\n* unify smac environment\r\n\r\n* RNN memory\r\n\r\n* RNN memory\r\n\r\n* memory no parameter sharing\r\n\r\n* memory unified for iddpg\r\n\r\n* model_keys\r\n\r\n* update maddpg and matd3\r\n\r\n* build training data\r\n\r\n* smac iql feedford is ok\r\n\r\n* experience replay buffer for MARL with RNN\r\n\r\n* experience replay buffer for MARL with RNN\r\n\r\n* experience replay buffer for MARL with RNN\r\n\r\n* update_rnn for iql\r\n\r\n* update_rnn for iql\r\n\r\n* iql rnn_update feedforward is ok\r\n\r\n* iql rnn_update feedforward is ok\r\n\r\n* iql rnn benchmark mode\r\n\r\n* iql rnn benchmark mode\r\n\r\n* iql rnn benchmark mode\r\n\r\n* iql rnn benchmark mode\r\n\r\n* iql\r\n\r\n* update iql configs\r\n\r\n* vdn agent and learner\r\n\r\n* vdn agent and learner and policy\r\n\r\n* vdn agent and learner\r\n\r\n* vdn learner and policy\r\n\r\n* vdn without rnn is ok\r\n\r\n* vdn rnn\r\n\r\n* vdn configs\r\n\r\n* iql configs\r\n\r\n* qmix learner and agent\r\n\r\n* qmix configs\r\n\r\n* qmix configs\r\n\r\n* qmix learner\r\n\r\n* q_tot of vdn and qmix\r\n\r\n* q_tot of vdn and qmix\r\n\r\n* wqmix\r\n\r\n* wqmix learner\r\n\r\n* update vdn and qmix\r\n\r\n* update vdn and qmix\r\n\r\n* wqmix learner\r\n\r\n* vdn and qmix learner\r\n\r\n* wqmix update and policy\r\n\r\n* wqmix update and policy\r\n\r\n* update wqmix learner\r\n\r\n* agents\r\n\r\n* raise error\r\n\r\n* update ppo\r\n\r\n* train epochs\r\n\r\n* train epochs\r\n\r\n* iql agent\r\n\r\n* ippo can run\r\n\r\n* ippo can run\r\n\r\n* use_actions_mask in learner\r\n\r\n* ippo learner\r\n\r\n* memory agent_key data, use_agents_mask\r\n\r\n* memory agent_key data, use_agents_mask cancel\r\n\r\n* update ippo prepare training data\r\n\r\n* ippo\r\n\r\n* update single agent\r\n\r\n* unified configs for single agent\r\n\r\n* update dqn\r\n\r\n* update a2c\r\n\r\n* update a2c\r\n\r\n* update ddpg\r\n\r\n* update pg\r\n\r\n* update ppg\r\n\r\n* update ppoclip and ppokl\r\n\r\n* update ppokl\r\n\r\n* update ppokl\r\n\r\n* ippo mpe discrete actions\r\n\r\n* ippo gaussain\r\n\r\n* ppokl is ok\r\n\r\n* sacdis\r\n\r\n* td3\r\n\r\n* update C51\r\n\r\n* ddqn\r\n\r\n* drqn\r\n\r\n* dueldqn\r\n\r\n* noisydqn\r\n\r\n* perdqn\r\n\r\n* qrdqn\r\n\r\n* pdqn\r\n\r\n* pdqn, mpdqn, spdqn\r\n\r\n* pdqn, mpdqn, spdqn\r\n\r\n* ippo config\r\n\r\n* APIs: common\r\n\r\n* APIs: common\r\n\r\n* APIs: common\r\n\r\n* APIs: policies\r\n\r\n* environment APIs\r\n\r\n* vectorizer\r\n\r\n* vectorizer\r\n\r\n---------\r\n\r\nCo-authored-by: Liu Wenzhang <lwz@192.168.0.100>","shortMessageHtmlLink":"created for 1.2.x (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2329718569\" data-permission-text=\"Title is private\" data-url=\"https://github.com/agi-brain/xuance/issues/40\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/agi-brain/xuance/pull/40/hovercard\" href=\"https://github.com/agi-brain/xuance/pull/40\">#40</a>)"}},{"before":"213551c2b2fa7cde67fcc35bdffcd68549d88cc9","after":"8756dbefb23519e0c95343effceb45de3c1b5d66","ref":"refs/heads/environment","pushedAt":"2024-06-02T15:17:21.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"vectorizer","shortMessageHtmlLink":"vectorizer"}},{"before":"f8cba41fe8b57fad03a93a6652a3ba972a6e68ea","after":"213551c2b2fa7cde67fcc35bdffcd68549d88cc9","ref":"refs/heads/environment","pushedAt":"2024-06-02T14:59:57.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"vectorizer","shortMessageHtmlLink":"vectorizer"}},{"before":"2596f4efc924020a6e89a24974e43ec91f992b81","after":"f8cba41fe8b57fad03a93a6652a3ba972a6e68ea","ref":"refs/heads/environment","pushedAt":"2024-06-02T14:35:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"environment APIs","shortMessageHtmlLink":"environment APIs"}},{"before":"86b235de6e6e884b0e7cc64342bf53f5352dbde8","after":"2596f4efc924020a6e89a24974e43ec91f992b81","ref":"refs/heads/environment","pushedAt":"2024-06-02T12:03:26.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"APIs: policies","shortMessageHtmlLink":"APIs: policies"}},{"before":"4d6dd83c3f8f1069f38973dab6afce0886f37d61","after":"86b235de6e6e884b0e7cc64342bf53f5352dbde8","ref":"refs/heads/environment","pushedAt":"2024-06-02T10:15:58.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"APIs: common","shortMessageHtmlLink":"APIs: common"}},{"before":"1ebe907f01619ee7ff6ed8cb8607cdd440faca61","after":"4d6dd83c3f8f1069f38973dab6afce0886f37d61","ref":"refs/heads/environment","pushedAt":"2024-06-02T08:58:27.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"APIs: common","shortMessageHtmlLink":"APIs: common"}},{"before":"389b685748462661ab97ae3c1cf71b3cd666b55e","after":"1ebe907f01619ee7ff6ed8cb8607cdd440faca61","ref":"refs/heads/environment","pushedAt":"2024-06-02T08:53:13.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"APIs: common","shortMessageHtmlLink":"APIs: common"}},{"before":"eeb2b8c6c43721a0f0ce43e80b16e7106e80ae40","after":"389b685748462661ab97ae3c1cf71b3cd666b55e","ref":"refs/heads/environment","pushedAt":"2024-06-02T08:32:01.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"ippo config","shortMessageHtmlLink":"ippo config"}},{"before":"cc8136fc4f2c07bcde79f95208f395f4d2a66d2f","after":"eeb2b8c6c43721a0f0ce43e80b16e7106e80ae40","ref":"refs/heads/environment","pushedAt":"2024-06-02T07:59:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"pdqn, mpdqn, spdqn","shortMessageHtmlLink":"pdqn, mpdqn, spdqn"}},{"before":"7f4b537f231e8bd6baf8fbed53980d241270a87b","after":"cc8136fc4f2c07bcde79f95208f395f4d2a66d2f","ref":"refs/heads/environment","pushedAt":"2024-06-02T07:58:16.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"pdqn, mpdqn, spdqn","shortMessageHtmlLink":"pdqn, mpdqn, spdqn"}},{"before":"0aeed94945b69d8414ab2f70dd034fbf0680e7d2","after":"7f4b537f231e8bd6baf8fbed53980d241270a87b","ref":"refs/heads/environment","pushedAt":"2024-06-02T05:57:23.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"qrdqn","shortMessageHtmlLink":"qrdqn"}},{"before":"f4bf62094fcffd6ea4bae5aa631aa3d96a316447","after":"0aeed94945b69d8414ab2f70dd034fbf0680e7d2","ref":"refs/heads/environment","pushedAt":"2024-06-02T05:48:01.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"perdqn","shortMessageHtmlLink":"perdqn"}},{"before":"a6c4879b129a37043e8d72f202f32b70c2a7f9ea","after":"f4bf62094fcffd6ea4bae5aa631aa3d96a316447","ref":"refs/heads/environment","pushedAt":"2024-06-02T05:08:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"noisydqn","shortMessageHtmlLink":"noisydqn"}},{"before":"85bf6a69f8b7d8c74c755f69af2a00a8da41e1bf","after":"a6c4879b129a37043e8d72f202f32b70c2a7f9ea","ref":"refs/heads/environment","pushedAt":"2024-06-02T04:49:18.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"dueldqn","shortMessageHtmlLink":"dueldqn"}},{"before":"e2a6373e145040abac7818dc510742f26d505963","after":"85bf6a69f8b7d8c74c755f69af2a00a8da41e1bf","ref":"refs/heads/environment","pushedAt":"2024-06-02T03:50:16.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"ddqn","shortMessageHtmlLink":"ddqn"}},{"before":"e1b03cef1e9f35fee7cb626c2e4207f7d4c6557f","after":"e2a6373e145040abac7818dc510742f26d505963","ref":"refs/heads/environment","pushedAt":"2024-06-02T02:45:59.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"sacdis","shortMessageHtmlLink":"sacdis"}},{"before":"83a2bbfc92ef9ec892c80d94b6a1774c635a7059","after":"e1b03cef1e9f35fee7cb626c2e4207f7d4c6557f","ref":"refs/heads/environment","pushedAt":"2024-06-02T00:42:25.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"ippo gaussain","shortMessageHtmlLink":"ippo gaussain"}},{"before":"1cfc96b233c79d51173db0dc6121b8633052d431","after":"83a2bbfc92ef9ec892c80d94b6a1774c635a7059","ref":"refs/heads/environment","pushedAt":"2024-06-01T14:15:32.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"ippo mpe discrete actions","shortMessageHtmlLink":"ippo mpe discrete actions"}},{"before":"07c53735e140b915bf4ecf9ed0d54a20a06d8ccd","after":"1cfc96b233c79d51173db0dc6121b8633052d431","ref":"refs/heads/environment","pushedAt":"2024-05-31T16:01:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"update ppokl","shortMessageHtmlLink":"update ppokl"}},{"before":"3930995c1fd90ec179899165d29b972c7c87ac3f","after":"07c53735e140b915bf4ecf9ed0d54a20a06d8ccd","ref":"refs/heads/environment","pushedAt":"2024-05-31T15:57:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"update ppokl","shortMessageHtmlLink":"update ppokl"}},{"before":"191dc29b326461c1be7fd0848ddc8065dbd9cc95","after":"3930995c1fd90ec179899165d29b972c7c87ac3f","ref":"refs/heads/environment","pushedAt":"2024-05-31T15:51:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"update ppoclip and ppokl","shortMessageHtmlLink":"update ppoclip and ppokl"}},{"before":"c8a3679f4cb387b9b0709a30fe1aa909aac7b6aa","after":"191dc29b326461c1be7fd0848ddc8065dbd9cc95","ref":"refs/heads/environment","pushedAt":"2024-05-31T15:14:01.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"wenzhangliu","name":"Wen-Zhang Liu","path":"/wenzhangliu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22970818?s=80&v=4"},"commit":{"message":"update ppg","shortMessageHtmlLink":"update ppg"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEW6VLDQA","startCursor":null,"endCursor":null}},"title":"Activity · agi-brain/xuance"}