You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
How many random seeds did you use to get the main evaluation results on the MultiWOZ2.0 dataset, e.g., Table 3 in your AAAI paper? If more than one seed is used, what are the other seeds except the SEED=10 in GALAXY/scripts/multiwoz2.0/train.sh?
In GALAXY/scripts/multiwoz2.0/infer.sh there is a command LOAD_MODEL_NAME=state_epoch_7. May I ask how you select this checkpoint (the 7-th/60 training epochs)? Is there a way that we can automatically select the best checkpoint?
Looking forward to hearing from you!
The text was updated successfully, but these errors were encountered:
Hi,
Great thanks for providing this fantastic repo!
I have two questions about the evaluations:
SEED=10
inGALAXY/scripts/multiwoz2.0/train.sh
?GALAXY/scripts/multiwoz2.0/infer.sh
there is a commandLOAD_MODEL_NAME=state_epoch_7
. May I ask how you select this checkpoint (the 7-th/60 training epochs)? Is there a way that we can automatically select the best checkpoint?Looking forward to hearing from you!
The text was updated successfully, but these errors were encountered: