There IS a physical universe, in case you somehow missed that.
The quote about god playing dice doesn't imply god exists -- it's actually about the laws of nature (how the universe operates). God's playing dice is just the phrasing it uses to make it more understandable.