When we call fit with Visualize=True everything works but strangely test doesn't. I think it's a good idea to look at if there is anything we can do to fix that - if we add random_initial_steps then test performs actions but it locks up when our model goes to take a step.