At the dinner hour

"At the time for the dinner" or "When the dinner was about to begin"

those who were invited

This can be stated in active form. Alternate translation: "those he had invited" (See: rc://en/ta/man/translate/figs-activepassive)