You will be left ... you were like ... you did not listen
Moses is speaking to the Israelites as a group, so all instances of "you" are plural.
you were like the stars of the heavens in number
This means that in the past there were many Israelites.
to the voice of Yahweh
"to what Yahweh says"
See in Reader