Votes are a terrible way of getting feedback on comments - I'd genuinely love to know if something I've said is "off topic" for the community but I often feel that some of my worst comments (one liners, or attempts at humor) actually get the most votes.
Perhaps some way of visualizing the way distribution of the karma bands for the people who voted on a comment (both positive and negative) would be good - I would actually go and check this occasionally to see if I was getting too far out of step.
e.g. Something that told me that your comment may have a total score of 30 but the people that have a karma level over 10000 who voted all downvoted etc.