I highly recommend keeping your wisdom teeth if you have room for them. I have all four -- a full rack as my dentist says -- and they're nice to have; I chew pretty far back in my mouth so they get lots of use. Cleaning them hasn't been a problem so far. I'm 42 years old.
Like you, I also had a baby tooth that didn't fall out. It was anchored to the bone somehow. It interfered with the movement of my adult teeth as they came in and thus had to be removed in my teens. It was a pain to get out. It had to be broken into pieces and dug out, and since there was no adult tooth to replace it, they put in an implant, which has also worked just fine.
My baby teeth are anchored to the bone as well, but not very strongly. They discovered them when fitting me for braces and decided they would just leave them. They didn't put anchors on the babies and just told me to pray they wouldn't fall out and they haven't!
I will probably keep my wisdom teeth. They're not fully in yet but I like the idea of not pulling anything out of my face, you know?
Like you, I also had a baby tooth that didn't fall out. It was anchored to the bone somehow. It interfered with the movement of my adult teeth as they came in and thus had to be removed in my teens. It was a pain to get out. It had to be broken into pieces and dug out, and since there was no adult tooth to replace it, they put in an implant, which has also worked just fine.