For they all wanted to make us afraid
"they" refers to Nehemiah's enemies, Sanballat, Tobiah, Geshem, and their followers. The word "us" refers to the Jews.
Their hands will drop from the work
"They will become discouraged and will stop working"
strengthen my hands
"give me courage"