China has released a set of guidelines on labeling internet content that is generated or composed by artificial intelligence (AI) technology, which are set to take effect on Sept. 1.
China, oh you Remembering something about go green and bla bla, but continue to create coal plants.
The Chinese government has been caught using AI for propaganda and claiming to be real. So I don’t see it happening within the Chinese government etc.
Will be interesting to see how they actually plan on controlling this. It seems unenforceable to me as long as people can generate images locally.
That’s what they want. When people doing it locally, they can discredit anything as AI generated. The point isn’t about enforability, but can it be a tool to control narative.
This is a smart and ethical way to include AI into everyday use, though I hope the watermarks are not easily removed.
Think a layer deeper how can it misused to control naratives.
You read some wild allegation, no AI marks (they required to be visible), so must written by someone? Right? What if someone, even the government jumps out as said someone use an illiegal AI to generate the text? The questioning of the matter will suddently from verifying if the allegation decribed happened, to if it itself is real. The public sentiment will likely overwhelmed by “Is this fakenews?” or “Is the allegation true?” Compound that with trusted entities, discrediting anything become easier.
Give you a real example. Before Covid spread globally there was a Chinese whistleblower, worked in the hospital and get infected. He posted a video online about how bad it was, and quickly got taken down by the government. What if it happened today with the regulation in full force? Government can claim it is AI generated. The whistleblower doesn’t exist. Nor the content is real. 3 days later, they arrested a guy, claiming he spread fakenews using AI. They already have a very efficient way to control naratives, and this piece of garbage just give them an express way.
You though that only a China thing? No, every entities including governments are watching, especially the self-claimed friend of Putin and Xi, and the absolute free speech lover. Don’t think it is too far to reach you yet.
It’s still a good thing. The alternative is people posting AI content as though it is real content, which is a worldwide problem destroying entire industries. All AI content should by law have to be clearly labeled.
It will be relatively easy to strip that stuff off. It might help a little bit with internet searches or whatever, but anyone spreading deepfakes will probably not be stopped by that. Still better than nothing, I guess.
Having an unreliable verification method is worse than nothing.
Having some AIs that do this and some not will only muddy the waters of what’s believable. We’ll get gullible people seeing the ridiculous and thinking “Well there’s no watermark so it MUST be true.”
That’s something that was really needed.
Lol. So everything and anything can just be AI generated fakenews.
Me: “hé <AI name> remove the small text which is at the bottom right in this picture”
AI: “Done, here is the picture cleaned of the text”
It makes more sense to mark authentic content but sure.
This is a bad idea. It creates a stigma and bias against innocent Artificial beings. This is the equivalent of forcing a human to wear a collar. TM watermark
Forgot the /s I assume
But I put in the water mark!
Would it be more effective to have something where cameras digitally sign the photos? Then, it also makes photos more attributable, which sounds like China’s thing.
No, I don’t want my photos digitally signed and tracked, and I’m sure no whistleblower wants that either.
Of course not. Why would they? I don’t want that either. But we are considering the actions of an authoritarian system.
Individual privacy isn’t relevant in such a country. However, it’s an interesting choice that they implement it this way.
That’s actually already a thing: https://www.theregister.com/2022/08/15/sony_launches_forgeryproof_incamera_digital/
That’s a different thing. C2PA is proving a photo is came from a real camera, with all the editing trails. All in a cryptographic manner. This in the topic is trying to prove what not real is not real, by self claiming. You can add the watermark, remove it, add another watermark of another AI, or whatever you want. You can just forge it outright because I didn’t see cryptographic proof like a digital sign is required.
Btw, the C2PA data can be stripped if you know how, just like any watermarks and digital signatures.
Stripping C2PA simply removes the reliability part, which is fine if you don’t need it. It is something that is effective when present and not when it isn’t.
Apart from the privacy issues, I guess the challenge would be how you preserve the signature through ordinary editing. You could embed the unedited, signed photo into the edited one, but you’d need new formats and it would make the files huge. Or maybe you could deposit the original to some public and unalterable storage using something like a blockchain, but it would bring large storage and processing requirements. Or you could have the editing software apply a digital signature to track the provenance of an edit, but then anyone could make a signed edit and it wouldn’t prove anything about the veracity of the photo’s content.
Hm, that’s true there’s no way to distinguish between editing software and photos that have been completely generated. It only helps if you want to preserve and modified photos. And of course, I’m making assumptions here that China doesn’t care very much about privacy.
