Possible meanings are 1) only two or three prophets speak at any one meeting or 2) only two or three prophets take turns.
"to what they say"