You're looking for a Hololens 2 like device, maybe HL3 will get there. HL2 is quite good imho, I've browsed HN while drinking coffee on the balcony. It occludes based on the environment (i.e. you can't see objects through walls)
To get this you need outward facing cameras, which people will balk at for privacy.
To get this you need outward facing cameras, which people will balk at for privacy.