Tests for restart files

We need unit tests for the restart functionality (see @dorchard's comment on PR #294). This includes
 -  are the restart files getting written
 - do they contain the correct data
 - are they written at the right time

I'm assigning this to @timspainNERSC for now, but it could be passed over to ICCS later.