Can someone explain to me how the design mockup demo and react generation relates to GPT-3? Isn't it just prompts? How is inputting a text outputting a design?
I believe those demos involve "priming" GPT-3 by providing a few examples of (text → generated code), then during inference time passing in just the text. The model would follow the examples provided and subsequently generate a string of code/mockup syntax, which is then evaluated.
The way GPT-3 works is that you provide it with examples of a question/input and an answer/output, then tack an unanswered question/input onto those examples and send the whole thing to the API. The AI then answers your question/generates your output.