Alibaba launched WanX 2.1, a new AI video generation model that competes with others like Sora from OpenAI and Veo 2 from Google. However, within just 24 hours, the tool became the source of dozens of pornographic videos uploaded to the internet.
One key aspect of WanX 2.1 is that it is an open-source model, with its code available on GitHub. This allowed users with the right technical knowledge to take advantage of it to generate pornographic content.
According to 404 Media, in communities dedicated to creating and sharing non-consensual pornographic deepfakes, users were excited about the advanced capabilities of Alibaba’s model.
Some of these videos were shared on Civitai, a platform where users exchange AI-generated images and videos, and even buy and sell them. The statistics for these models show they have already been downloaded hundreds of times.
404 Media reports that there are already dozens of pornographic videos created with WanX 2.1. While Civitai allows users to share AI models, it does not permit non-consensual content. However, this does not prevent users from downloading the models and using them to generate such videos on their own.
Once again, the issue lies in how these tools, which can create impressive and legitimate videos, also enable the production of problematic content. It has already been proven that deepfakes can be highly profitable, and the rapid advancement of these technologies makes controlling them increasingly difficult.
