MORE INFO FOR SJ PREVIEWS AND HARVESTS

[richardmatthewsdev]

Acceptance Criteria

• Harvest operators can see timely information about progress and key events when running harvests, enrichments and previews
• UAT SJ stack used to minimise disruption to harvesters

ActionCable should/could emit things like this:

PREVIEW (show all messages appended to screen in a separate tab)
(and maybe just the latest message in the existing 'status' line)

• preview queued
• preview started
• url requested
• url request response
• parsing record
• record rejected (based on parser rejections criteria)
• Any other errors
• Reached end of urls/file
• Preview doing stuff for enrichment (I dont actually know what it does)

HARVEST/ENRICHMENT (maybe show last 10 or 20 actions? in another tab?)

• url requested
• url request response
• parsing record
• record rejected (based on parser rejections criteria)
• Any other errors
• writing to API/mongo?
• Reached end of urls/file
• Paginating