TechCrunch News 04月23日 03:36
A Chinese AI video startup appears to be blocking politically sensitive images
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

中国初创公司Sand AI发布了开源视频生成AI模型Magi-1,引发关注。然而,该模型在其在线平台上对图像进行了审查,屏蔽了可能触及中国监管机构敏感神经的图像,如涉及政治人物、事件和标志的图像。虽然Magi-1在技术上展现了潜力,但其审查行为反映了中国对AI内容实施的严格管控。文章探讨了中国AI模型在政治内容审查方面的普遍做法,以及与西方同类产品在内容过滤标准上的差异,揭示了商业利益与政治监管之间的复杂关系。

👁️ Sand AI发布的Magi-1模型,通过“自回归”预测帧序列来生成视频,声称可以生成高质量、可控的视频,其技术参数达到240亿,需要4到8个Nvidia H100 GPU才能运行。

🚫 Sand AI的在线平台屏蔽了上传涉及中国国家主席、天安门广场、“坦克人”、台湾旗帜以及支持香港解放等内容的图像。这种过滤似乎发生在图像层面,重命名文件也无法规避审查。

⚖️ 与其他中国AI公司类似,Sand AI对政治敏感内容进行审查,以符合中国的严格信息控制法规。但与西方同类产品相比,这些模型在过滤色情内容方面的限制较少。

A China-based startup, Sand AI, has released an openly licensed video-generating AI model that’s garnered praise from entrepreneurs like Microsoft Research Asia founding director Kai-Fu Lee. But Sand AI appears to be censoring images that might raise the ire of Chinese regulators from the hosted version of the model, according to TechCrunch’s testing.

Earlier this week, Sand AI announced Magi-1, a model that generates videos by “autoregressively” predicting sequences of frames. The company claims the model can generate high-quality, controllable footage that captures physics more accurately than rival open models.

Magi-1 is too impractical to run on most consumer hardware. It’s 24 billion parameters in size, and requires between four and eight Nvidia H100 GPUs to run. (Parameters are the internal variables models use to make predictions.) For many users — this reporter included — Sand AI’s platform is the only place they can test drive Magi-1.

The platform needs a “prompt” image to kick off video generation. Not all prompts are permissible, TechCrunch quickly discovered. Sand AI blocks image uploads of Xi Jinping, Tiananmen Square and Tank Man, the Taiwanese flag, and insignias supporting Hong Kong liberation. Filtering appears to be happening at the image level; renaming image files didn’t skirt the blocking.

Sand AI’s online platform throws an error message when it detects a likely prohibited image.Image Credits:Sand AI

Sand AI isn’t the only Chinese startup preventing uploads of politically sensitive images to its video generation tool. Hailuo AI, Shanghai-based MiniMax’s generative media platform, blocks photos of Xi Jinping as well. But Sand AI’s filtering appears to be particularly aggressive; Hauiluo allows images of Tiananmen Square.

As Wired explained in a piece from January, models in China are required to follow stringent information controls. A 2023 law forbids models from generating content that “damages the unity of the country and social harmony” — that is, counters the government’s historical and political narratives. To comply, Chinese startups often censor their models, either through prompt-level filters or fine-tuning.

Interestingly, while Chinese models tend to block political speech, they often have fewer filters than their American counterparts for pornographic content. 404 recently reported that a number of video generators released by Chinese companies lack basic guardrails that prevent people from generating nonconsensual nudity.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

Sand AI Magi-1 AI审查 视频生成 中国
相关文章