D.A. Carson explains "I don't even judge myself" from 1 Corinthians 4:3. He writes, "Christian leaders must prove faithful to the One who has assigned them their fundamental task (4:1-4)...Those who are servants of Christ, those who are entrusted with the secret things of God, do not see themselves winning popularity contests - not even within the church's borders. That is what Paul means when he says, 'I care very little if I am judged by you or by any human court' (4:3). There is only one Person whose 'Well, done!" on the last day means anything. In comparison, the approval or diapproval of the church means nothing.
It is not even your own estimate of your service that is important. Feeling good about your ministry may have some limited utility somewhere, but surely it has no ultimate significance. You may think more highly of your service than God does; you may think less of your service than God does. But if you are constantly trying to please yourself, to make self-esteem your ultimate goal then you are forgetting whose servant your are, whom you must strive to please... What he (Paul) means is that his own judging of himself cannot possible have ultimate significance."