I don’t have an easy (non-destructive) fix for that one and I actually do voice chats with my laptop. I’d feel better about a real hardware switch for both or a separate device. Sadly that doesn’t seem to be an option.
There's external microphones with an on/off switch; of course, if you can't tell Mac to never use the builtin microphone it's probably neither here nor there.