That would be throwing out the good with the bad. The phone isn't just an internet portal, it's a music player, a navigation system, an audiobook player, a book reader, etc.
Yep. I've deleted Facebook and it's reduced my time wasting. I still pull my phone out, swipe left, swipe right, realize there's nothing for me to do and then put my phone away. (I have most notifications turned to minimal/off)
But LOVE my audio books and podcasts and google maps and digital note pad and dictionary and wikipedia... And never feel guilty about those things.