It can probably create more than cartoons, and even with cartoons there are plenty of very offensive and dangerous terms you could use to create dangerous and offensive cartoons. I mean, I would love to be able to type in anything I want into DALL-E, but the time from release to it sparking some kind of geopolitical incident could probably be measured in hours.
So the fact that somewhere on earth there might exist some fanatical people who might be offended by something, becomes sufficient reason to shut down access to a cartoon generating capability?
Seems like you are setting a pretty low bar for what we will allow with AI on one end, and what will trigger an AI feature’s general availability to be cancelled, on the other end. Everything else in between these two is going to be even harder.
To make my point more clear, imagine a magic quadrant with two axes. On one axis it goes from capability - harsh to mild. Harsh would be like "it can physically burn and kill everything to ashes" and mild would be "it can temporarily distract someone."
The other axis would be who gets affected. That axis goes from "every living being in the known universe" on one end, to "nobody" on the other end, with "a very small handful of fanatics with extreme outlier beliefs" somewhere out there toward the "nobody" end.
In the graph, you are setting the bar way over on the "just a slight distraction" side, and way over toward the edge of the "nobody" side, and saying that this is sufficient reason to cancel AI access for the general public.
> but the time from release to it sparking some kind of geopolitical incident could probably be measured in hours.
This sounds like a huge exaggeration. At the resolution of DALL-E, anyone can photoshop or draw something of the same quality.
Also, this argument was unsuccessfully used when OpenAI claimed that releasing GPT-2 was going to cause massive societal strife. They released it later, and life continues on.
Anyone can draw an offensive cartoon. They are withholding the solution for money. If a startup that is removing backgrounds from photos is worth close to $100M (remove.bg) imagine how much this is worth. This technology is worth billions and could replace illustrators in many cases in web design, content, etc.
