It's worth noting that SD card firmware is usually optimised for the FAT32 filesystem, which has a very predictable access (specifically write) pattern, and using filesystems that have a more "free-form" layout can lead to lower performance and higher write amplification:
Good note, I wonder if wear leveling depends on that since it's local wear leveling compared to SSD global.
SDXC probably requires exFAT and free space bitmap is considered.
https://lwn.net/Articles/428584/