Yahweh was angry with me because of you

This refers to when Moses disobeyed what Yahweh told him to do because Moses was angry with the people of Israel. See Numbers 20:11-12.

Yahweh your God is giving to you

Moses speaks to the Israelites as if they were one man, so "you" and "your" are singular.