The word "they" refers to God's steadfast love and compassions. Their being new represents God continuing to act according to them. Alternate translation: "every morning he treats us again with steadfast love and compassion" (See: [[rc://en/ta/man/translate/figs-metaphor]])