Pharaoh said this to emphasize that he would not let the Israelites take the women and children with them to worship Yahweh. When he said, "May Yahweh indeed be with you," he may have been warning Moses that the Israelites would need Yahweh to protect them from Pharaoh.