Scirate [1] is an arxiv overlay with upvotes (called scites) and a comment section. The scite function does quite help a lot with bubbling up the better papers to the top. But I have never seen any serious discussion in the comments section - only clarifying questions, or missed citations.
[1] https://scirate.com/arxiv/quant-ph (go to previous day to see more scites)