The patent office is made out of experts which should have a much higher expertise in judging if an patent is valid than a judge. It make no sense to give the patent office the vast majority of "easy" patents, and then give the non-experts judges the issue of all the troublesome "hard" patents which has been challenged.