NVIDIA Canvas 是一款基于人工智能的绘画工具，利用 NVIDIA 的 GauGAN 模型，将简单的笔触转化为逼真的风景画。它提供多种材料和风格选择，让用户可以轻松创作出令人惊叹的图像，并支持全景模式，为 3D 应用创建 360 度图像。

🎨 **基于 GauGAN 模型的 AI 驱动**: NVIDIA Canvas 利用 NVIDIA 的 GauGAN 模型，将简单的笔触转化为逼真的风景画。GauGAN 是一种生成对抗网络 (GAN)，由 NVIDIA 研究团队开发，旨在将草图转化为照片般逼真的图像。它通过两个相互竞争的神经网络——生成器和鉴别器——来实现这一目标。生成器尝试创建逼真的图像，而鉴别器则尝试区分真实图像和生成图像。在不断挑战彼此的过程中，GAN 越来越擅长生成逼真的图像。

🖌️ **直观的绘画体验**: Canvas 提供了一个直观的界面，用户可以使用各种材料（如草、云、山等）进行绘画。用户只需绘制简单的线条和形状，AI 模型就会实时生成增强后的图像。例如，使用“山”材料绘制几个三角形，就会生成一个壮丽的、逼真的山脉。或者，用户可以选择“云”材料，只需点击几下鼠标，就可以将环境从阳光明媚变成阴云密布。

🖼️ **丰富的创作可能性**: Canvas 提供九种不同的风格，每种风格都有 10 种变体和 20 种材料供用户选择。用户可以创作出各种各样的场景，例如池塘、树木、岩石、雪景、热带天堂等等。此外，Canvas 还提供全景模式，允许用户创建 360 度图像，用于 3D 应用。

🚀 **应用场景**: NVIDIA Canvas 可以用于各种目的，例如创作艺术作品、制作游戏场景、创建 3D 模型等等。它为艺术家和设计师提供了强大的工具，让他们能够轻松地创作出逼真的图像。

🤝 **与其他 NVIDIA 产品的协同**: NVIDIA Canvas 与其他 NVIDIA 产品，例如 NVIDIA Broadcast 和 NVIDIA RTX GPU，协同工作，提供更强大的功能。NVIDIA Broadcast 是一款 AI 驱动的视频会议工具，可以将任何房间变成家庭工作室。NVIDIA RTX GPU 为 Canvas 提供了强大的图形处理能力，确保实时生成逼真的图像。

Editor’s note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

Generative models have completely transformed the AI landscape — headlined by popular apps such as ChatGPT and Stable Diffusion.

Paving the way for this boom were foundational AI models and generative adversarial networks (GANs), which sparked a leap in productivity and creativity.

NVIDIA’s GauGAN, which powers the NVIDIA Canvas app, is one such model that uses AI to transform rough sketches into photorealistic artwork.

How It All BeGAN

GANs are deep learning models that involve two complementary neural networks: a generator and a discriminator.

These neural networks compete against each other. The generator attempts to create realistic, lifelike imagery, while the discriminator tries to tell the difference between what’s real and what’s generated. As its neural networks keep challenging each other, GANs get better and better at making realistic-looking samples.

GANs excel at understanding complex data patterns and creating high-quality results. They’re used in applications including image synthesis, style transfer, data augmentation and image-to-image translation.

NVIDIA’s GauGAN, named after post-Impressionist painter Paul Gauguin, is an AI demo for photorealistic image generation. Built by NVIDIA Research, it directly led to the development of the NVIDIA Canvas app — and can be experienced for free through the NVIDIA AI Playground.

GauGAN has been wildly popular since it debuted at NVIDIA GTC in 2019 — used by art teachers, creative agencies, museums and millions more online.

Giving Sketch to Scenery a Gogh

Powered by GauGAN and local NVIDIA RTX GPUs, NVIDIA Canvas uses AI to turn simple brushstrokes into realistic landscapes, displaying results in real time.

Users can start by sketching simple lines and shapes with a palette of real-world elements like grass or clouds —- referred to in the app as “materials.”

The AI model then generates the enhanced image on the other half of the screen in real time. For example, a few triangular shapes sketched using the “mountain” material will appear as a stunning, photorealistic range. Or users can select the “cloud” material and with a few mouse clicks transform environments from sunny to overcast.

The creative possibilities are endless — sketch a pond, and other elements in the image, like trees and rocks, will reflect in the water. Change the material from snow to grass, and the scene shifts from a cozy winter setting to a tropical paradise.

Canvas features a Panorama mode that enables artists to create 360-degree images for use in 3D apps. YouTuber Greenskull AI demonstrated Panorama mode by painting an ocean cove, before then importing it into Unreal Engine 5.

Download the NVIDIA Canvas app to get started.

Consider exploring NVIDIA Broadcast, another AI-powered content creation app that transforms any room into a home studio. Broadcast is free for RTX GPU owners.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what’s new and what’s next by subscribing to the AI Decoded newsletter.