my fortress
Yahweh is spoken of as if he were a strong fortress in which the writer would be protected from his enemies.
for your name's sake
"so that your name may be honored" or "so that I may worship you"
lead and guide me
"lead me where you want me to go"
See in Reader