Except not really with proper E2EE. Go and join a new Signal or WhatsApp group. You'll notice they're empty. As you were not around for a key exchange when the messages were initially sent.
It's possible to implement shared history systems where newly invited members of a group can request access to the history of a group, while preserving E2EE security.
Encryption ≠ E2EE.