do not trouble ... will not give you

Moses speaks to the Israelites as if they were one man, so the command and the word "you" are singular.

to the descendants of Lot

The people of Israel were related to the descendants of Ammon. Ammon was the son of Lot. Lot was the nephew of Abraham.