Well, more generally it says that there is value in having on site meetings.
I think it is fair to say that the OP's measure of his net productivity doesn't match that of his coworkers/employer... else they'd leave him alone when he came in to the office. Now, you can argue whose perceptions are accurate, but in the end the employer's perceptions are kind of all that matters.