# But you have

James is speaking to his whole audience. 

# have dishonored the poor

"you have shamed poor people"

# Is it not the rich who oppress you?

"It is rich people who oppress you."

# the rich

"rich people" 

# who oppress you

"who treat you badly"

# Are they not the ones ... to court?

"The rich people are the ones ... to court."

# drag you to court

"forcibly take you to court to accuse you in front of judges"