has given rest

Here "rest" refers to peace with surrounding nations.

He makes his home in Jerusalem forever

Possible meanings are 1) Yahweh will be present in Jerusalem forever or 2) Yahweh's temple will be present in Jerusalem forever.