# do not trouble ... will not give you

Moses speaks to the Israelites as if they were one man, so the command and the word "you" are singular. 

# to the descendants of Lot

The people of Israel were related to the descendants of Ammon. Ammon was the son of Lot. Lot was the nephew of Abraham.