Better to find the cheapest house that fits your want list regardless of past ownership.
The house I bought doubled for the last owner during his 6 years here. It doubled for me in half of the time since. The past owner wasn't greedy the market moved on its own.
Yes that is probably irrational "caveman" thinking. Never said it was logical.