On: There are infinite worlds to explore

[uejfiweun]

Pretty cool stuff - I eagerly await the day when the same generative models can spit out fully explorable 3D environments that I can then explore in VR.

[andybak → uejfiweun]

Yeah - that's my wish too. I think all the pieces already exist but you'd need a supercomputer to get realtime frame rates.

[DethNinja → andybak]

You don’t need a supercomputer.

You can actually hook algorithmic art from Houdini to GAN models and bake 3D art for later use.

Problem is that GAN models are still not good enough to produce human level realistic images.

It can generate trippy images but these are not very useful for commercial products.

We still need better models or a completely different approach for computer generated realistic art.

[ShamelessC → DethNinja]

Diffusion models are better - but their inference times are orders of magnitude slower.

GAN models are really cool. Don't get me wrong. But they are popular _because_ they are fast at inference. They are still challenging to train (hopefully projected GAN helps with this) and have a very tough time representing highly diverse datasets with lots of data.

[andybak → DethNinja]

> You can actually hook algorithmic art from Houdini to GAN models and bake 3D art for later use.

I've seen some stuff like that but it's not really what I'm talking about. I want fully dynamic, spatially consistent generative worlds.

And that is pretty hard to do at 75 or so FPS in stereo.