"the people who were in debt to his master" or "the people who owed things to his master." In this story the debtors owed olive oil and wheat.