hmmm, that's a tricky one, not to imply that you're wrong for looking at it that way or that I think this applies to you, but if person A has a 10% higher score than person B but lives an empty, soal sucking life, while person B lives a life full of love, meaning, and joy....
Maybe that's one of the trickiest parts of life, it's sufficiently complicated so that if you're doing a bad job, you almost innately won't have the perspective to recognize it.