I feel like we see this message for other reasons too, like the app isn't compiled correctly. Also, restarting the app doesn't necessarily put it into a state where the test can continue. If the app crashes or dies, I think we should end the session and 500 the currently request.