This does not mean the high priest could never leave. God did not allow him to leave in order to grieve over someone who died.