Skip to content

SLTev evaluation is taking excessively long #71

@bhaddow

Description

@bhaddow

Hi

Running SLTev sometimes takes excessively long to evaluate (about 10 minutes). An example is available at http://www.statmt.org/bhaddow/SLTev-slow-mwe/

I run with:

SLTeval  -i ende.teacher.k0.en-de.en.txt.slt en-de.de.txt en-de.en.txt.OStt -f slt ref ostt

Profiling the code, I see that it spends most of its time here:

def extract_match_tokens_based_on_time(estimat_times, display_times, start, end):

I do not know the code well enough to know what the problem is, but (eg) the two loops could be combined, and the iteration should use for x in list rather than range()

best
Barry

Metadata

Metadata

Assignees

No one assigned

    Labels

    invalidThis doesn't seem right

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions