As God, Yahweh is everywhere and cannot be limited to a single space. This phrase indicates that he permanently remains within Israel in a special way while they have the ark.
See in Reader