Gotta love Adam Smith, writing as he does from a ruling class perspective.
So he writes of the working class man:
The torpor of his mind renders him, not only incapable of relishing or bearing a part in any rational conversation, but of conceiving any generous, noble, or tender sentiment, and consequently of forming any just judgment concerning many even of the ordinary duties of private life. (Wealth of Nations V.i.f.50)
By contrast, the cultured refinement of the ruling class intellectual (like Smith himself) is a terrible burden:
The contemplation of so great a variety of objects necessarily exercises their minds in endless comparisons and combinations,and renders their understandings, in an extraordinary degree, both acute and comprehensive. Unless those few, however, happen to be placed in some very particular situations, their great abilities, though honourable to themselves, may contribute very little to the good government or happiness of their society. Notwithstanding the great abilities of those few, all the nobler parts of the human character may be, in a great measure, obliterated and extinguished in the great body of the people. (V.i.f.51)