Sure, I didn't mean to suggest it can't be done in short spurts. But reading a novel that way would be hellish.
The larger point being, Japanese isn't locked into using a logographic system - it already has two phonetic syllabaries that people could start using exclusively if there was some advantage to doing so.
That sounds like an absolutely miserable experience. I'd rather be forced to look up every 3rd or 4th kanji than try to deal with all hiragana writing.
Having read English language papers on Japanese linguistics, I can also say that reading the Latin is easy too.