"They" refers to members of the tribe of Levi; the word "you" is singular and refers to Aaron.
"do all the work"
Here "you" is plural and refers to both Aaron and the rest of the Levites.