On: OpenAI Five Benchmark

[lightbyte]

I think OP wants to know how the neural network actually plays the game. I think in this case the dota client has an api for bots that it can use?

[gdb → lightbyte]

Yes, there's a bot API.

We dump state from the bot API each tick and send it over GRPC to a Python agent, which formats the state into a tuple of Numpy arrays. That Numpy array is passed into 5 neural networks (one per agent), each of which returns a tuple of Numpy arrays. Each tuple is decoded into a semantic action, which is then returned to the game via GRPC.

[chlvsl → gdb]

Is the entire system one agent, which is then replicated across 5 bot instances, or do you have a specific network per hero?