I visit more than a handful. How useful do you think a dozen unfamiliar favicons on my tabs or bookmarks are?
And why would I have to visit billions of sites? The issue is that billions of sites exist, and a random little picture tells me nothing about what site it's from unless I already have it memorized.