Arrogance is an interesting topic.
Let's imagine we have two people who are having a conversation. One of them is an professor in quantum mechanics and the other person is an enthusiast who has read a few popular science articles online.
The professor always gives his honest opinion, but in an extremely blunt manner, not holding anything back and not making any attempts to phrase it politely. That is, the professor does not merely tell the enthusiast that they are wrong, but also provides his honest assessment that the enthusiast does possess even a basic understanding of the core concepts of quantum mechanics.
The enthusiast is polite throughout, even when subject to this criticism. They respond to the professors objections about their viewpoints, to the best of their ability throughout, trying their best to engage directly with the professors arguments. At the same time, the enthusiast is convinced that he is correct - equally convinced as the professor in fact - but he does not vocalise this in the same way as the professor.
Who is the most arrogant in these circumstances? Is this even a useful question to ask - or should we be dividing arrogance into two components - over-confidence and dismissive behaviour?
Let's imagine the same conversation, but imagine that the enthusiast does not know that the professor is a professor and neither do the bystanders. The bystanders don't have a knowledge of quantum physics - they can't tell who is the professor and who is the enthusiast since both appear to be able to talk fluently about the topics. All they can see is that one person is incredibly blunt and dismissive, while the other person is perfectly polite and engages with all the arguments raised. Who would the bystanders see as most arrogant?
Believing that you can bluntly tell things you are confident about implies believing that your social status is not too low. (Or a lack of social awareness.) People with very low status know they would get kicked even for saying "2+2=4" too confidently.
Regardless of what the allegedly-arrogant person believes, I think what's happening when someone is accused of arrogance for being "too" confident about a belief is generally that the accuser sees what they say about that belief as claiming higher status than they deserve.
In a (laughably unreal) ideal world, in these cases "status" would mean "reputation for accurate beliefs" and "deserve" would mean "deserve on the basis of known ability to form accurate beliefs in this area". In practice, it often comes down to the same sort of ape-hierarchy status that applies everywhere else.
As you will have guessed, I share Qiaochu's opinion that "arrogant" usually means approximately "trying to claim higher status than they have/deserve". This probably means that those of us who don't think highly of status as a guide to accuracy, trustworthiness, etc. should often prefer terms other than "arrogant" when describing others. casebash's example suggests that "overconfident" and "rudely dismissive" would be good candidates.