Here "they" refers to the Israelites and "you" to Yahweh.
"you abandoned them and allow their enemies to defeat them"