On: Why small tweaks and split testing don't work, and...

[sixo]

> Having the video auto play converted visitors almost 50% more often than them having to click the play button (it may be evil, but it makes money).

Because the ones who weren't going to convert never came back

[stevenwliao → sixo]

It may or may not be true that they never came back. A good split test tool will tell you that as well.

[TeMPOraL → stevenwliao]

I'm increasingly of the opinion that split-testing tools are the hidden way Satan influences the world. If your A/B tests keep telling you that you should make the product more user-hostile and less useful, that you should manipulate the users and abuse the commons for short-term gains, something is very wrong - with the tools, the tests, or the world.

[stevenwliao → TeMPOraL]

Split testing can be used by companies who care about their users and companies who don't. It just tells you how your users react. It's not a substitute for user empathy or regulations.