I'd love to see an equal amount of the effort put toward initiatives like this, also being put toward mitigating their extremely likely negative societal impacts (and putting in safeguards).
Of course, that's not nearly as sexy.
Yes, there are lots of incredible positive impacts of such technology, just like there was with fire, or nuclear physics. But that doesn't mean that safeguards aren't absolutely critical if you want it to be net win for society.
These negative impacts are not theoretical. They are obvious and already a problem for anyone who works in the right parts of the security and disinformation world.
Of course, some of the same people who ignored recommendations[1] for harm mitigations in visual deepfake synthesis tools (which ended up being used for espionage and botnets) seem to be working on this.
Of course, that's not nearly as sexy.
Yes, there are lots of incredible positive impacts of such technology, just like there was with fire, or nuclear physics. But that doesn't mean that safeguards aren't absolutely critical if you want it to be net win for society.
These negative impacts are not theoretical. They are obvious and already a problem for anyone who works in the right parts of the security and disinformation world.
We've been through all this before... https://aviv.medium.com/the-path-to-deepfake-harm-da4effb541...
Of course, some of the same people who ignored recommendations[1] for harm mitigations in visual deepfake synthesis tools (which ended up being used for espionage and botnets) seem to be working on this.
[1] e.g. https://www.technologyreview.com/2019/12/12/131605/ethical-d...