You can yes, but the rumor is that Apple is focusing on adding them directly to your device, and if they integrate it deeply in the OS, then it will require the chips to run it. I’m sure you will be able to run old devices but without the latest Siri for example.
The wildcard here is local LLM use cases and any new hardware that increases their speed by orders of magnitude.