Polite company in this case is well bred class.
Explanation:
In the paragraph in the question, the polite company means the class of the people who are very intelligent, well known, qualified and are highly intellectual.
The examples of these well bred people in this paragraph are queen Victoria, mother of the Prime Minister and so on all the intellectual people in Great Britain.
