> why the phrase "large red ball" feels more correct than "red large ball",
Because size is relative quantity(large as relative to what) while red is absolute descriptor(color=red).
I don't think this is a sufficient explanation, only empirical observation. It could very well be other way around. I mean it's not even generally true that related words come together in sentence (things like "Who did you give the large red ball to?" spring to mind).
