I also recommend the non-fiction physics book “The End of Time” by Julian Barbour. It explains these ideas directly, and inspired Stephenson to write Anathem.
Weirdly, I happened to be reading all 3 of these around the same time, not initially realizing they were connected.
