This is a Greek term meaning "the masses," "the many." If you use it, do not say "the hoi polloi," because hoi is Greek for "the": "This dictator thinks of everyone in the country as hoi polloi."
Dictionary of problem words and expressions. Harry Shaw. 1975.