This seems like a very bizarre characterization. Technically On the Origin of Species by Charles Darwin and Relativity by Einstein are non-fiction. I'm very happy to say I've had my mind warped by their pet theories.
They both present compelling evidence and can be thus classified as science. Darwin spent a couple decades accumulating evidence before he wrote the book.
Also, majority of non-fiction textbook are about psychology, economy, sociology, history etc. which are vastly more intractable than biology and physics.