The trick is to ensure you are never near all the people who know the secret when there is the possibility of trouble. That makes kidnapping everyone harder.
Of course if you really worry about such things you shouldn't be trusting the other people you are working with either...