they bowed down with their faces to the ground on the stone pavement

"they lay down on the ground with their faces touching the stone pavement". This is a position of humility and worship.

his covenant loyalty endures forever

"God will always be loyal to us because of his covenant" or "God will always faithfully do for us what he promised"