CDSA 03月06日
Dubformer Raises $3.6M in Seed Funding to Elevate AI Dubbing to New Heights of Emotional Expression
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

总部位于阿姆斯特丹的AI配音初创公司Dubformer宣布完成360万美元种子轮融资,由Almaz Capital领投,s16vc和FinSight等跟投。此轮融资将用于提升其AI技术,增强配音中的情感深度,致力于为电视、广播和电影制作提供更优质的媒体本地化服务。Dubformer通过Emotion Transfer技术,捕捉并转移语音中的细微情感,而非简单复制声音,从而生成更自然、更具沉浸感的配音。其技术在WMT机器翻译竞赛中名列前茅,目前已服务于Paramount、Little Dot Studios等200多家欧美客户。

🚀 Dubformer 是一家专注于专业AI配音的初创公司,通过360万美元的种子轮融资,致力于提升AI配音的情感表达,从而改进媒体本地化。

🗣️ Dubformer 的核心创新在于其 Emotion Transfer 技术,该技术能够捕捉并转移语音中的情感,而不是像传统的AI配音解决方案那样简单地复制声音,从而使配音更加自然和真实。

🏆 Dubformer 的AI配音技术在2024年WMT机器翻译竞赛中表现出色,在语音翻译方面排名第一,并在包括西班牙语在内的多种语言中获得整体最高分,证明了其技术的领先性。

🌍 Dubformer 的技术已通过其开放平台和API提供给用户和创作者,服务于美国和欧洲的200多家客户,包括Paramount、Little Dot Studios和Mainstream Media等,并与Voxx、Presto和Gobavo等公司建立了合作关系。

Dubformer, an Amsterdam-based startup specializing in professional AI dubbing, announced a $3.6 million seed funding round to push the boundaries of emotional expression in AI dubbing, enhancing media localization for TV, broadcast, and film productions.

The round was led by Almaz Capital, with s16vc and FinSight as key investors, along with angel investors such as Arul Menezes, founder of Microsoft Translator, and Funa Maduka, former
head of International Original Film at Netflix. This funding will enable Dubformer to advance its proprietary AI technologies and enhance emotional depth in voice performance, aligning with its mission to make content accessible and enjoyable globally.

Market problems

Despite impressive advances in the AI dubbing industry, the quality of AI-generated dubbed content still falls short of being convincingly realistic. Recent research indicates that emotional voices are likely to be identified as human, while neutral tones are generally associated with AI.

This distinction not only affects how viewers perceive the content but also influences their overall enjoyment.

The video localization market, currently worth $7 billion, is growing at a compound annual growth (CAGR) of 16% to meet the increasing global demand. In addition to independent companies offering dubbing solutions, major players also invest in internal innovation to enhance content localization and expand audience reach.

Dubformer’s innovation

Dubformer addresses the key market challenges with Emotion Transfer, a technology which enhances dubbing by transferring emotions instead of cloning voices, as conventional AI dubbing solutions do.

At the core of Emotion Transfer lies its ability to generate fine-grained local aspects of speech — such as intonation, emotion, and pace — using source audio as a reference. This is
generative dubbing, not mere voice replication. Because languages have unique prosodic features, perfectly mimicking all speech nuances is impossible. This approach delivers dubbing
that is significantly more natural and immersive compared to conventional technologies such as text-to-speech or voice cloning.

“With Emotion Transfer, we also capture the acoustic characteristics — such as echoes and reverberations — enhancing the overall experience. Our focus is on creating full immersion,
making sure the dubbing never feels out of place,” said Anton Dvorkovich, Founder & CEO of Dubformer.

In 2024, Dubformer’s AI dubbing technology competed in WMT, the leading annual machine translation competition held as part of the conference of the same name. WMT attracts major
players from both industry and academia, including Google Translate, DeepL, ChatGPT, and Claude. Dubformer’s solution ranked highest for speech translation, and highest overall in
multiple languages, including Spanish.

Background and plans

Dubformer was founded in September 2023 by Anton Dvorkovich, a machine translation expert with 10+ years of experience and former Head of NLP & Speech at Yandex. The core team, experts in AI and speech technology, previously launched the world’s largest AI dubbing solution which had over 5M users and 150M minutes watched daily.

Since its launch, Dubformer has grown rapidly, gaining traction among media companies and content creators. Over the past six months, the platform’s growth has accelerated significantly, averaging more than 50% month-over-month, reflecting the surging demand for high-quality, emotionally expressive AI dubbing.

Dubformer now serves over 200 clients across the U.S. and Europe, including Paramount, Little Dot Studios, and Mainstream Media. It also has partnered with companies such as Voxx (Los
Angeles), Presto (Czech Republic), and Gobavo (Turkey).

“In a rapidly evolving AI dubbing landscape, Dubformer is committed to driving the industry forward by addressing its key challenges. Through capturing the emotional essence of content,
we enable media companies to expand their global audience reach while reducing localization costs — all without compromising viewer satisfaction,” said Anton Dvorkovich, Founder & CEO
of Dubformer.

Dubformer’s technology is also accessible to users and creators through its open platform and
API.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

Dubformer AI配音 Emotion Transfer 媒体本地化
相关文章