An association with Oppenheimer is not that surprising. He worked with Oppenheimer, they were both on the Manhatten project. Also, Oppenheimer's security clearance being revoked seems to have also been a lot to do with Edward Teller creating FUD after being pissed off at Oppenheimer for not wanting to put resources into the H-bomb.