Yeah. Or have a little metal case with you into which you put your device. Or buy a roll of aluminum foil and just wrap the phone inside it (just spelling this out makes me feel like a conspiracy theory nutter). So many cheap options...
There are fairly cheap little faraday cage forensic bags that LEOs often purchase in bulk. Power off phone, slip phone in, it's not transmitting any more.