It would be nice if it the intermediate checkpoints (at eval_save_interval) also (optionally) produced files containing the optimizer state.