| 50 mins | The Latest Generative AI, Authentication, and Content Authenticity | Wenjing Chu will lead the discussion. | - How the latest Generative AI technologies such as ChatGPT and DALL-E may render "content-based" authentication methods ineffective.
- Deepfakes and content authenticity.
- Possible solutions.
The presentation document is here. First up - a video of a digital avatar looking and sounding credibly like Morgan Freeman - raises questions - what do you believe? what do you feel? The initial focus is CHatGPT (GPT4) ( others on the list for "another time"). Exams/Tests such as LSAT, PSAT, counter-factuals, theory of mind (current and new "Turing tests") to evaluate AI vs. humans. Ging to skip over those for. Computing has fundamentally changed w the generation of Generative AI. How does this change digital trust? What are the new directions Wenjing did a 60 min+ session wi ChatGPT on a technical subject, which Wenjing was somewhat knowledgeable - verdict - it was a useful session and provided learning value (equivalent to a conversation w a human expert?) MS and Google Office-type tools will incorporate this (likely immediately). A credible, accurate (vs. bias) search is next. Can this avoid bias of pushing paid data sources (see Cory Doctorow on the "Inshitification of the Internet" on how search is polluted by profits vs. knowledge)? AI may be a path to editing & summarizing of content produced by one or more experts, including film editing. Medium to long-term speculation is likely to be quickly superseded. Content Authenticity. - DeepFake has passed a critical threshold (the iPhone moment)
- AI makes it much harder to find the origin of content (particularly if blended)
- Stronger Dig Identity help? Verification? What role does anonymous vs. accountable play? Credibility of ID + reputation?
- Can't rely on the content itself (to prove authentic)
- Can C2PA (Content Provenance and Authenticity) help?
- Yes, but needs v good tools, techniques
- Fraudulent presentation of fact is hard, and fake presentation of fake, is impossible to prove as fact provenance can't prove not-fake (factual)
- Tracking history may not help.
- 3 approaches (apply to content generators and consumer tools (e.g., social media) )
- Alignment - AI improvement + regulation
- Watermarking (AI tool improvement)
- Signing/Manifest (AI tool improvement)
- If the original content is not correctly attributed, then all downstream processing is moot (from a digital trust perspective
From Chat: - For ToIP, unless content can be verified, the default should be rejected.
- Can effective (untamperable, fully traceable) signatures be placed in any/all digital content?
- But of course, there is a high operational cost in this -so how do we decide what content needs to have embedded signatures, especially in routine social media content
- EFWG had a team from https://www.frankliapp.com/about who were discussing one part of the problem of fake/synthetic content (2 weeks ago?)
- Content and provenance of what tools/algorithms made modifications/processing applied - in many cases knowing which tools were used to change original content is revealing in itself. Who controls the model
Fake Identity : Authentication Key contexts - Human or robot?
- Bypass authentication (security issue)
- Dual Identity
Determining identity due diligence is highly dependent on the medium (e.g., in-person, vs phone (voice only), vs online video, ...) Will be an "arms race" between generators (of fake) and detectors. There is no purely digital solution will work as always subject to human operator manipulation - it always needs independent, authoritative human verification Dual Identity - who are you speaking to, and who is responsible for the identity's behaviour? Do you know or care if it is real? - There are markets for real and fiction (books, movies)
- A way to do this is to have the creator (author), and processors sign this (editor, etc.)
- Reputation needs to be made concrete to do this (mix of verified credentials and contextual reputation)
- Will anyone follow up on checking the content provenance?
- Or is this a required logo/icon to click for provenance
Dan B
- can't rely on Biometrics as that is effectively publically available (e.g., fingerprints on a glass, scan of a retina, etc.)
- one solution is facial + bloodflow in real-time - https://www.iproov.com/ |