Just make sure they have a large enough buffer, and buffer enough, so that all speakers can play the same frames at the same time (or with the exact delay you want for each specific speaker).
You only care about delay between the speakers, not about what latency any speaker has relative to the source.
You only care about delay between the speakers, not about what latency any speaker has relative to the source.