That's probably the weakest of my examples, since lollipop hammers are at least valuable for their utility within a video game.
I would think of art NFTs as more like character or weapon skins - completely useless except that it's visually appealing and you can show off your "ownership" of it to other people within the game. With art NFTs, the "game" so far is just NFT viewing tools, social media profile pics, etc.
Actually, premium Steam profile borders might be an even more apt analogy, since they aren't tied to any game and are also useful solely for vanity.
Of course, then you have NFTs that actually do represent usable in-game items like with Axie Infinity or Gods Unchained, but that's an adjacent topic.