Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding heterogeneous observation social dilemma environment #4

Draft
wants to merge 38 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 34 commits
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
4e65617
add base env for multi obs and socialdill with multi obs
marimeireles Feb 20, 2024
5a21dac
change names to MultipleObsSocialDilemma from socialdilemma
marimeireles Feb 20, 2024
0860304
Work feb21
marimeireles Feb 21, 2024
5416ebb
add hetero
marimeireles Feb 24, 2024
51b9adf
Modify multi obs social dilemma
marimeireles Feb 24, 2024
cc44813
dont remember wt i changed hetero and mul obs env
marimeireles Feb 24, 2024
6dea33c
fix observabiity reward and transition for heterogeneuous environments
marimeireles Feb 29, 2024
fa3668d
Fix the observation gen tension function and fix from transparency to…
marimeireles Feb 29, 2024
85f10e5
Last version of hetero env before making it compat with history
marimeireles Mar 2, 2024
3ab50a5
Change Observation type to be explicitely string
marimeireles Mar 2, 2024
26f086f
Change hetero env so its env = . .
marimeireles Mar 2, 2024
b827a82
Change set in the correct place
marimeireles Mar 2, 2024
e45d1b6
Remove this nb bc it's confusing me
marimeireles Mar 2, 2024
e96586d
Add the states to the right class finally
marimeireles Mar 2, 2024
5e05c86
Update py files for heteroobs and multiobsdilemma
marimeireles Mar 2, 2024
006d119
Stringfication of history into py file
marimeireles Mar 2, 2024
b415071
Call Tss function with an explicity object
marimeireles Mar 2, 2024
a558dca
Organize and add some tests to the multi obs env
marimeireles Mar 2, 2024
f960634
Observations dont have to sum up[ to 1 anymore because we might have …
marimeireles Mar 5, 2024
c297264
Fix the label generation for Osets
marimeireles Mar 5, 2024
ef85f5b
Testing a bunch of stuff remove null chars so i can compile?
marimeireles Mar 5, 2024
627a9c4
Remove null chars from ebase
marimeireles Mar 5, 2024
81deb30
Change the if conditions so it accepts any kinds of numbers not only …
marimeireles Mar 5, 2024
aaf561c
Make call for parent class explicit on APOBase
marimeireles Mar 10, 2024
3c70da3
Make call for parent class explicit on APOBase
marimeireles Mar 10, 2024
dffeeb6
Notebooks with corrected observations and different kinds + a few exa…
marimeireles Mar 10, 2024
ce6b25b
Finish 12multipleobssoc and rm explorations
marimeireles Mar 12, 2024
6d47d3d
Add the ability to have different types of obs within the same game
marimeireles Mar 12, 2024
8ed5f37
Remove content added by me on hist env embedding nb
marimeireles Mar 12, 2024
fa8f6dc
Adding screenshot from tests ran in h222 env
marimeireles Mar 12, 2024
c96083c
Explorations with het obs AC
marimeireles Mar 12, 2024
4573ee6
Delete irrelevant nb
marimeireles Mar 12, 2024
c21b7e1
Final adjustments initialization and exs and comments
marimeireles Mar 15, 2024
31f9157
Add generated py files
marimeireles Mar 15, 2024
d46c1dc
Introduces incomplete SARSA POS strategy
marimeireles Mar 22, 2024
01dd1dd
Comment hOset function
marimeireles Mar 24, 2024
7050cd2
Up to date v of heterogeneous obs env
marimeireles Mar 28, 2024
ac8ee53
Fix missing self in obs assert
marimeireles Mar 28, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
16 changes: 14 additions & 2 deletions nbs/Agents/98_APOBase.ipynb
Expand Up @@ -168,7 +168,7 @@
" def Tss(self, X):\n",
" \"\"\"Compute average transition model Tss given policy X\"\"\"\n",
" Xisa = self.Xisa(X)\n",
" return super().Tss(Xisa)\n",
" return abase.Tss(self, Xisa)\n",
" \n",
" def Bios(self, X):\n",
" \"\"\"\n",
Expand Down Expand Up @@ -1082,9 +1082,21 @@
],
"metadata": {
"kernelspec": {
"display_name": "python3",
"display_name": "Python 3 (ipykernel)",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.10.3"
}
},
"nbformat": 4,
Expand Down
1,104 changes: 1,104 additions & 0 deletions nbs/Agents/98_APOBase_commented.ipynb

Large diffs are not rendered by default.