# I long for the courts of Yahweh

"I really want to be in the courts of Yahweh"

# the courts of Yahweh

Here "courts" represent the temple. 

# my desire for it has made me exhausted

"my desire has exhausted me" or "I am tired because I want it so much"

# My heart and all of my being shout for joy

"I shout for joy with all of my being" 

# the living God

This means God is living and he also has the power to cause other things to live.