In her book Quiet[1], Susan Cain claims that introverts are more sensitive to external stimuli[2]. This would probably make them less able to tune out distractions and thus more stressed out by noisy workplaces where there are lots of people talking.
She also explicitly discusses workplace issues as they relate to introverts and extroverts.[3]
It's an interesting book, especially for tech people, a lot of whom tend to either be introverts or work with lots of introverts.