TechCrunch News 03月31日 23:28
Runway releases an impressive new video-generating AI model
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

Runway公司发布了其最新的AI视频生成工具Gen-4,声称在视频生成质量上达到了新的高度。该工具能够生成连贯的角色、场景和物体,保持一致的世界环境,并从不同角度和位置重新生成元素。Gen-4允许用户通过参考图像和指令来创作具有一致风格、主题和位置的视频,无需额外的微调或训练。Runway面临来自OpenAI和Google等公司的竞争,但通过与好莱坞工作室的合作以及对AI生成视频电影的投资,努力实现差异化。

🎬Gen-4是Runway推出的新一代AI视频生成工具,其核心优势在于生成高度动态、具有真实运动感的视频,同时保持主体、物体和风格的一致性,并更好地遵循指令。

🖼️Gen-4允许用户通过提供主体图像和描述所需场景的构图来创作视频,能够利用视觉参考和指令,生成风格、主题和位置一致的新图像和视频,从而增强故事的连贯性和可控性。

💡Runway在训练Gen-4时使用了大量的视频样本来学习其中的模式,但出于竞争优势和潜在的知识产权诉讼风险,并未公开训练数据的来源。公司目前正面临艺术家提起的诉讼,指控其未经许可使用受版权保护的艺术作品进行训练。

💰Runway正在寻求新一轮融资,预计公司估值将达到40亿美元,并希望在今年实现3亿美元的年化收入,这表明公司对Gen-4等产品的商业前景充满信心。

📉然而,生成式AI视频工具的发展也对电影和电视行业带来了冲击。一项研究表明,采用AI技术的电影制作公司中,75%的公司减少、合并或消除了工作岗位,预计到2026年,将有超过10万个美国娱乐业工作岗位受到影响。

AI startup Runway on Monday released what it claims is one of the highest-fidelity AI-powered video generators yet.

Called Gen-4, the tool is rolling out to the company’s individual and enterprise customers. Runway claims that it can generate consistent characters, locations, and objects across scenes, maintain “coherent world environments,” and regenerate elements from different perspectives and positions within scenes.

“Gen-4 can utilize visual references, combined with instructions, to create new images and videos utilizing consistent styles, subjects, locations, and more,” Runway wrote in a blog post, “[a]ll without the need for fine-tuning or additional training.”

Runway, which is backed by investors including Salesforce, Google, and Nvidia, offers a suite of AI video tools, including video-generating models like Gen-4. It faces stiff competition in the video generation space, including from OpenAI and Google. But the company has fought to differentiate itself, inking a deal with a major Hollywood studio and earmarking millions of dollars to fund films using AI-generated video.

Runway says that Gen-4 allows users to generate consistent characters across lighting conditions using a reference image of those characters. To craft a scene, users can provide images of subjects and describe the composition of the shot they want to generate.

“Gen-4 excels in its ability to generate highly dynamic videos with realistic motion as well as subject, object, and style consistency with superior prompt adherence and best-in-class world understanding,” the company claims in its blog post. “Runway Gen-4 represents a significant milestone in the ability of visual generative models to simulate real-world physics.”

Gen-4, like all video-generating models, was trained on a vast number of examples of videos to “learn” the patterns in these videos to generate new footage. Runway refuses to say where the training data came from, like many vendors these days — partly out of fear of sacrificing competitive advantage. But training details are also a potential source of IP-related lawsuits if Runway trained on copyrighted data without permission.

Runway faces a lawsuit brought by artists against it and other generative AI companies that accuses the defendants of training on copyrighted artwork without permission. Runway argues that the doctrine known as fair use provides legal cover.

The stakes are somewhat high for Runway, which is said to be raising a new round of funding that would value the company at $4 billion. According to The Information, Runway hopes to hit $300 million in annualized revenue this year following the launch of products like an API for its video-generating models.

However the lawsuit against Runway shakes out, generative AI video tools threaten to upend the film and TV industry as we know it. A 2024 study commissioned by the Animation Guild, a union representing Hollywood animators and cartoonists, found that 75% of film production companies that have adopted AI have reduced, consolidated, or eliminated jobs after incorporating the tech. The study also estimates that by 2026, more than 100,000 U.S. entertainment jobs will be disrupted by generative AI.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

Runway Gen-4 AI视频生成 人工智能 影视行业
相关文章