Tqdm Progress bar can become too big

[mzouink]

When submitting a cluster task tqdm save a new line for twice for each block which can become a gigabytes file

Is there a way to make an option that set update frequency ? or use an other option that saves only the last line

[pattonw]

This sounds like it would be a great addition. We have an observer pattern implemented for handling updates while blockwise processing here: https://github.com/funkelab/daisy/blob/master/daisy/cl_monitor.py

I think we could consider a couple reasonable approaches:

1. add verbosity arguments to the existing monitor
2. add a new ServerObserver subclass specifically for remote execution where you do not want the progress bar at all but rather just a tidy log file

[vaxenburg]

I think it would be nice to have an option to specify the progress bar update frequency (in units of time, e.g. seconds). Something like this:

update_time_delta = 0  # Update immediately (the way it currently works).
update_time_delta = 60  # Update every minute.
update_time_delta = float('inf')  # Silent mode, never update.
update_time_delta = None  # Silent mode, never update.