"all around him" or "where he is"
The author speaks as if strength and joy are people who can be in Yahweh's sanctuary.
"in his temple" or "in his sanctuary"