Workload confusion

[yagarea]

Hello,
I have project containing 1500 documents. Annotators are just classifying documents to categories and can let optional note. We have 6 annotators. Our plan was to make every annotator annotate 600 documents so every document would be annotated twice (for agreement check).

Workload settings

Problem

Current state:

• 792 documents were annotated by two people
• Annotator A has annotated 457 documents

Annotator A wrote me message that inception shows her same documents again and again.

• Why is this happening and how can I make inception to assign 600 unique documents?
• Is there any way to see overview of status of annotation? (like histogram of individual progress or lists of documents assigned to individual annotators)

[reckart]

In dynamic workload mode, annotators need to mark documents as finished. Once a document has been marked as finished, it will no longer be shown and the annotator will be offered the next document. The annotator willl be unable to go back to a finished document.

If you want annotators to be able to go back to documents and not be forced to mark them as finished, you can use the static workload mode and automatically - yet statically - distribute the work across the annotators.