cs.AI updates on arXiv.org 07月11日 12:04
SonicMotion: Dynamic Spatial Audio Soundscapes with Latent Diffusion Models
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

本文提出了一种名为SonicMotion的端到端模型,旨在通过生成AI技术提升3D场景中动态声源的效果。模型包括两种变体,分别针对用户输入和声源定位精度,同时引入了模拟空间音频-字幕对的新数据集,实验表明该模型在语义对齐和音频质量上可与现有顶级模型相媲美。

arXiv:2507.07318v1 Announce Type: cross Abstract: Spatial audio is an integral part of immersive entertainment, such as VR/AR, and has seen increasing popularity in cinema and music as well. The most common format of spatial audio is described as first-order Ambisonics (FOA). We seek to extend recent advancements in FOA generative AI models to enable the generation of 3D scenes with dynamic sound sources. Our proposed end-to-end model, SonicMotion, comes in two variations which vary in their user input and level of precision in sound source localization. In addition to our model, we also present a new dataset of simulated spatial audio-caption pairs. Evaluation of our models demonstrate that they are capable of matching the semantic alignment and audio quality of state of the art models while capturing the desired spatial attributes.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

生成AI 3D声源 空间音频 SonicMotion 模型评估
相关文章