Here "I" refers to Isaiah.
"who has taken away his blessing from the people of Israel" or "who no longer looks with favor on the people of Israel"