to deprive a person of justice

"to judge a person wrongly in court" or "if they keep a person who goes to a judge from getting what is right"

the Lord would not approve such things!

The phrase "such things" refers to the three wicked actions listed in verses 34-36.