I'm not sure how they'll get much use out of this one. They show (not very representative) screen shots and then ask broad questions, like "Would you say this design is rather confusing or clear?" and "Would you say this design is rather boring or inspiring?"
Setting aside that I don't understand why "rather" is in all of the questions, they're still not great. Is the design of a screwdriver inspiring? I guess not. Is that bad? Definitely not. I don't need my tools to be fonts of warm fuzzy feelings. I need them to be useful.
Even if the questions were material, asking it about a whole screenshot composed of many different design changes inevitably muddles things. And asking it only of 1 old and 1 new screenshot invites people to judge on novelty, not utility.
So my suspicion is that the survey isn't really testing any useful hypotheses. We know that some people like new shiny and some people like old familiar. I don't think much is gained here.
I've been through the survey and it is quite bad, the questions are purely marketing centered, trying to figure out the perceived image people have of the software based of a single screenshot.
Where are the question about usability and practicality ?
Said screenshots are from much different screen resolution so one is cluttered[1] and the other is illegible[2].
The whole survey gives the idea that the current design is bad and the new is better. I mean when you get asked to rate an old thing vs a new one on a scale between outdated and modern.
https://medium.com/research-things/on-surveys-5a73dda5e9a0
I'm not sure how they'll get much use out of this one. They show (not very representative) screen shots and then ask broad questions, like "Would you say this design is rather confusing or clear?" and "Would you say this design is rather boring or inspiring?"
Setting aside that I don't understand why "rather" is in all of the questions, they're still not great. Is the design of a screwdriver inspiring? I guess not. Is that bad? Definitely not. I don't need my tools to be fonts of warm fuzzy feelings. I need them to be useful.
Even if the questions were material, asking it about a whole screenshot composed of many different design changes inevitably muddles things. And asking it only of 1 old and 1 new screenshot invites people to judge on novelty, not utility.
So my suspicion is that the survey isn't really testing any useful hypotheses. We know that some people like new shiny and some people like old familiar. I don't think much is gained here.