You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I think this is a reasonable idea, but because it's a relatively minor use case (most major datasets like WMT, IWSLT, WAT have only one reference), I'd say it's maybe a little bit lower priority. We'd also need to make sure we don't add too much complexity to the code.
Hi @neubig, thanks for this tool! I'm planning to use it to analyze models for WebNLG, a NLG shared task, and they provided more than one reference text per entry, so I'm also curious if compare-mt can support analysis over multiple references. Do you have any idea if it is too complex to implement that?
Sometimes we may have multiple references. Would it be nice to support analysis over multiple references?
The text was updated successfully, but these errors were encountered: