who appointed me a judge or a mediator over you?

Jesus uses a question to rebuke the man. Alternate translation: "do not expect me to be your judge and mediator."

you

This word refers to the man and his brother.