This is true. I got a tailored suit and shirts for my wedding. It turns out that dress clothes can be quite comfortable if they fit you. When they're uncomfortable, it's largely because off the rack clothing is designed to be as generic as possible.
Hear hear. Potential metaphors:
1) The difference between healthy tasty food and unhealthy tasty food. "Oh nothing made with <ingredient X such as broccoli> tastes good". Chances are you've just not eaten it prepared well
2) The difference between fast food and a tasty home cooked meal. It takes time and effort to make a home cooked meal which tastes good (usually). Some people would rather just eat crap....it works for them.