it is a very small thing that I should be judged by you

Paul is comparing the difference between human judgment and God's judgment. God's judgment upon man is the most important.