Like with audio, the challenges are going to be doing this in real time. You can have a conversation with e.g. chat gpt but it needs a few seconds to process what you say, come up with an answer, and then talk to you. It's a bit awkward. Imagine a version of that with an AI avatar like this. It would probably require quite a bit of performance improvements to get that to level of responsiveness that feels natural. And real life conversations are not just about talking realistically but also about non verbal communication when listening. So, it would have to adapt to what you are saying while your saying it for it to be completely natural.
That being said, this is pretty awesome for a lot of use cases that are less interactive.
That being said, this is pretty awesome for a lot of use cases that are less interactive.