Hacker News new | past | comments | ask | show | jobs | submit login

1 is definitely an issue, but has a solution. I posted an article about this a while back with a simple example of the problem and a possible solution. The example is a staged rollout but it illustrates the same point. If you change proportions of tests over time as there are independent changes, you can get skewed results: http://blog.avidlifemedia.com/2011/12/23/advanced-ab-testing...



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: