The word "mouth" represents the whole person who cries out to God.
"I praised him with my tongue" or "I praised him"