On the Limits of Dictatorial Classification