The word "glory" here refers to wealth or riches. Possible meanings are 1) "when he gains more wealth in his house" or 2) "when his family becomes richer."
The phrase "go down" refers to when the man dies. AT: "his glory will not go along with him when he dies" or "he will not keep his reputation when he dies" (See: [[rc://en/ta/man/translate/figs-euphemism]])