"He remembers"
Both "the covenant" and "the oath" refer to the same promise that Yahweh made to his people.