Non-programmers know that they're not supposed to understand programming. People who've taken a reasonable number of math classes tend to feel like they should know more than a tiny fraction of the math that's out there, even if this expectation is unreasonable.
I know I found it pretty depressing the first time I realized that after taking fourteen or so years of math classes I'd never really made it past Advanced Arithmetic.