TechCrunch News 2024年12月03日
World Labs’ AI can generate interactive 3D scenes from a single photo
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

World Labs,由人工智能先驱李飞飞创办的初创公司,推出首个项目:利用AI从单张图像生成类似电子游戏的3D场景。该系统能够将图像转化为可交互探索的3D场景,并保持场景一致性和物理规律。它不仅可以应用互动效果和动画,还能解决现有世界模型存在的伪影和一致性问题,例如低分辨率和快速遗忘关卡布局等。World Labs的目标是为艺术家、设计师等专业人士提供工具,并应用于电影、游戏等领域,有望彻底改变我们创造虚拟世界的模式。

🤔World Labs利用AI技术,从单张图像生成可交互探索的3D场景,实现了图像到3D世界的转换,并保证了场景的一致性和物理规律。

🎮该系统能够应用互动效果和动画,例如改变物体颜色和动态灯光背景,增强了3D场景的互动性和表现力。

🚧与现有世界模型相比,World Labs的系统解决了伪影和一致性问题,例如低分辨率和快速遗忘关卡布局等,提升了3D场景的质量和稳定性。

💰World Labs已获得2.3亿美元的风险投资,估值超过10亿美元,计划在2025年推出首款产品,目标客户包括游戏开发者、电影工作室等。

🎯World Labs的愿景是为艺术家、设计师、开发者等专业人士提供工具,帮助他们更便捷、高效地创建虚拟世界,改变电影、游戏、模拟器等数字世界的构建方式。

World Labs, the startup founded by AI pioneer Fei-Fei Li, has unveiled its first project: an AI system that can generate video game-like, 3D scenes from a single image.

The AI-generated scenes, which anyone with a keyboard and mouse can explore on a demo on World Labs’ website, look impressive — if a bit cartoonish. They’re rendered live in the browser, and have a controllable camera with an adjustable simulated depth of field (DoF). The stronger the DoF effect, the blurrier background objects appear.

World Labs’ system is a part of an emerging category of AI called “world models.” Many of these models can simulate games and 3D environments — but with artifacting and consistency issues. For example, startup Decart’s Minecraft-simulating world model, Oasis, has a low resolution and quickly “forgets” the layout of levels.

World Labs’ system converts an image into an interactive, explorable 3D scene. Image Credits:World Labs

In contrast, World Labs’ approach ensures that scenes remain the same once they’re generated, and that they obey the basic laws of physics, meaning they have a sense of solidity and depth.

World Labs’ system can also apply interactive effects and animations to scenes, like changing the color of objects and dynamically lighting backdrops.

“Most generative AI tools make 2D content like images or videos,” World Labs wrote in a blog post. “Generating in 3D instead improves control and consistency. This will change how we make movies, games, simulators, and other digital manifestations of our physical world.”

Now, there’s certainly room for improvement. World Labs’ scenes aren’t fully explorable — your movements are limited to a small area. (Try moving outside it, and you’ll hit a boundary.) And there’s the occasional rendering error, for example objects that blend together in unnatural ways.

A scene generated by World Labs’ system. Image Credits:World Labs

But World Labs says that it’s only an “early preview.”

“We are hard at work improving the size and fidelity of our generated worlds, and experimenting with new ways for users to interact with them,” they wrote in the blog.

World Labs, which launched earlier this year, has raised $230 million in venture capital from investors including Andreessen Horowitz (a16z), Ashton Kutcher, Intel Capital, AMD Ventures, and Eric Schmidt. Valued at over $1 billion, the company hopes to have its first product ready in 2025.

Beyond interactive scenes, World Labs plans to build tools that might be useful to professionals like artists, designers, developers, filmmakers, and engineers. It’s targeting customers ranging from video game developers to movie studios.

Part of the demo on World Labs’ site. Image Credits:World Labs

“We already have the ability to create virtual, interactive worlds, but it costs hundreds and hundreds of millions of dollars and a ton of development time,” World Labs co-founder Justin Johnson said on a recent episode of the a16z podcast. “[World models] will let you not just get an image or a clip out, but a fully simulated, vibrant, and interactive 3D world.”

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

World Labs 人工智能 3D场景生成 世界模型 虚拟世界
相关文章