OpenAI's video-generating app, Sora, has raised significant questions regarding
the safety and privacy of user's biometric data, particularly with its "Cameo"
feature that creates realistic AI videos, or "deepfakes," using a person's face
and voice.
To power this functionality, OpenAI confirms it must store users'
facial and audio data. The company states this sensitive data is encrypted
during both storage and transmission, and uploaded cameo data is automatically
deleted after 30 days. Despite these assurances, privacy concerns remain. The
app's ability to generate hyper-realistic videos has sparked fears about the
potential for misuse, such as the creation of unauthorized deepfakes or the
spread of misinformation.
OpenAI acknowledges a slight risk that the app could
produce inappropriate content, including sexual deepfakes, despite the
safeguards in place. In response to these risks, the company has implemented
measures to distinguish AI-generated content, including visible watermarks and
invisible C2PA metadata in every video created with Sora .
The company emphasizes that
users have control over their likeness. Individuals can decide who is permitted
to use their cameo and can revoke access or delete any video featuring them at
any time. However, a major point of contention is the app's account deletion
policy. Deleting a Sora account also results in the termination of the user's
entire OpenAI account, including ChatGPT access, and the user cannot register
again with the same email or phone number.
While OpenAI has stated it is
developing a way for users to delete their Sora account independently, this
integrated deletion policy has surprised and concerned many users who wish to
remove their biometric data from Sora without losing access to other OpenAI
services.
The app has also drawn attention for potential copyright violations,
with users creating videos featuring well-known characters from popular media.
While OpenAI provides a mechanism for rights holders to request the removal of
their content, the platform's design has positioned it as a new frontier for
intellectual property disputes.
