There are consequences if you go away from your controller during a game.