Multiple references

[zdou0830]

Sometimes we may have multiple references. Would it be nice to support analysis over multiple references?

[neubig]

I think this is a reasonable idea, but because it's a relatively minor use case (most major datasets like WMT, IWSLT, WAT have only one reference), I'd say it's maybe a little bit lower priority. We'd also need to make sure we don't add too much complexity to the code.

[abevieiramota]

Hi @neubig, thanks for this tool! I'm planning to use it to analyze models for WebNLG, a NLG shared task, and they provided more than one reference text per entry, so I'm also curious if compare-mt can support analysis over multiple references. Do you have any idea if it is too complex to implement that?

[zdou0830]

Thanks! I guess I can start working on this after #26 is fixed?