What format works well for hardware caching?
As small as you can tolerate tbh. The game is played by keeping data as small as possible and ensuring that related data has good locality in memory.
The gap between how fast your CPU works and how fast data can be retrieved from RAM is enormous.
What format works well for hardware caching?