# go to your house

Jesus is not forbidding the man to go elsewhere. He is giving the man the opportunity to go home.