The comment that the author make about "men of large calibre" through this analogy is that "Their faults do not reduce their worth to society." "Men of large calibre" means that these men have a big reputation in the society. They are of well-known group, well-respected and well-brought up by their wealth and power.