You don’t have a choice in some areas, like the south SF bay (unless you are a multimillionaire). The sources of asbestos are well known and they can be removed cleanly and safely, and lead paint should have been painted over by now with more than a few coats of modern paint — which you can safely touch and lick, if you like.
You never remodel or have to repair holes in the walls of your home? In my experience, we would have lead based paint particles floating all around the house from all the projects and fixes we do.
Presumably you’d baby proof your home and would address any spots where the paint is flaking or chipping off the wall. Especially if you knew it was an older home.
Honestly unless the lead paint is the topmost layer, or they put so many coats of regular paint on that it’s falling off the wall, the actual risk of a toddler encountering and then consuming the paint chips is shockingly low.