It used to be that the "intellectual elite" were religious figures, and that still remains the case in some societies. In the west, that status-quo changed some time ago, when, for whatever reason, artsy, politically-minded people who embraced and pushed for socialist ideals became the west's "intellectual elite."
This reminds me of the saying, "Never talk about religion and politics," as discussions concerning either, generally end up with people on both sides who once liked each other, but when the "discussions" between polar opposites naturally end in disagreement, want to destroy those on the other side.
To me, the intellectual elite today, represent people who aren't really that into the concept of total freedom, and in fact, want to take the rights of those who are free away, with their veiled claims that the people aren't intelligent enough to make their own decisions. The classic claim of tyrants.