But they took him

"But the vine growers took the servant"

empty-handed

This means that they did not give him any of the fruit. Alternate translation: "without any grapes" (See: rc://en/ta/man/jit/figs-explicit)