Unite.AI 03月05日
Dubformer Raises $3.6M to Revolutionize AI Dubbing with Emotion Transfer Technology
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

AI配音初创公司Dubformer获得了360万美元的种子轮融资,旨在重新定义媒体本地化中情感深度的捕捉方式。Dubformer的Emotion Transfer技术,能够复制语音中的情感细微差别,将语调、节奏和情感深度从原始表演转移到配音版本。在WMT 2024机器翻译竞赛中,Dubformer在语音翻译中排名最高。目前,Dubformer已服务于美国和欧洲的200多家客户,包括派拉蒙、Little Dot Studios和Mainstream Media等。

🚀Dubformer的Emotion Transfer技术是其核心竞争力,它不只是克隆声音,而是复制语音中的情感细微差别,保证配音无缝集成到任何场景中。

🏆Dubformer在WMT 2024机器翻译竞赛中表现出色,在语音翻译中排名最高,超越了谷歌翻译、DeepL和ChatGPT等主要竞争对手,证明了其技术实力。

🌍Dubformer提供多种AI配音解决方案,包括面向内容创作者和小型企业的自助服务平台、面向本地化公司的专业工具,以及面向广播公司和内容分发商的全方位AI配音服务。

🤝Dubformer与Voxx(洛杉矶)、Presto(捷克共和国)和Gobavo(土耳其)等国际公司合作,扩大其全球业务范围,进一步巩固其在AI配音领域的地位。

AI dubbing startup Dubformer has secured a $3.6 million seed funding round to redefine how emotional depth is captured in media localization. The investment, led by Almaz Capital with participation from s16vc and FinSight, as well as angel investors including Arul Menezes, founder of Microsoft Translator, and Funa Maduka, former head of International Original Film at Netflix, will fuel the company’s mission to make dubbed content more immersive and engaging for audiences worldwide.

Solving AI Dubbing’s Biggest Challenge

Despite significant advancements in AI dubbing, most solutions still struggle to convey authentic emotion in voiceovers. Research shows that audiences can easily distinguish between human and AI-generated speech, primarily due to AI’s lack of expressive tone. This limitation diminishes the viewer’s experience and affects engagement with localized content.

With the video localization industry valued at $7 billion and growing at a 16% CAGR, media companies are eager for innovative solutions that improve dubbing quality without the high costs associated with traditional voice acting. Enter Dubformer, a company that is tackling this challenge head-on.

Emotion Transfer: The Next Evolution in AI Dubbing

Unlike conventional AI dubbing that clones voices, Dubformer has pioneered Emotion Transfer, a technology designed to replicate the emotional nuances of speech. Instead of simply translating and synthesizing words, this cutting-edge approach transfers the intonation, pace, and emotional depth from the original performance to the dubbed version.

“At Dubformer, we’re not just recreating voices—we’re capturing the essence of performance,” said Anton Dvorkovich, Founder & CEO. “With Emotion Transfer, we also retain acoustic characteristics like echoes and reverberations, ensuring that the dubbing seamlessly integrates into any scene.”

Proven Industry Recognition

Dubformer’s AI dubbing technology has already gained recognition in the industry. At WMT 2024, one of the most prestigious competitions in machine translation, Dubformer ranked highest in speech translation and top overall in multiple languages, outperforming major players like Google Translate, DeepL, and ChatGPT.

Rapid Growth and Expanding Client Base

Founded in September 2023 by Anton Dvorkovich, a machine translation expert and former Head of NLP & Speech at Yandex, Dubformer has experienced explosive growth. Over the past six months, the company has maintained a staggering 50% month-over-month growth rate, reflecting the increasing demand for AI dubbing solutions.

Currently, Dubformer serves over 200 clients across the U.S. and Europe, including major names such as Paramount, Little Dot Studios, and Mainstream Media. The company has also partnered with international firms like Voxx (Los Angeles), Presto (Czech Republic), and Gobavo (Turkey) to expand its global footprint.

AI Dubbing for Every Industry

Dubformer provides dubbing solutions for a range of industries, including TV, animation, and film production. Its technology is accessible through an open platform and API, making it easy for content creators, localization companies, and broadcasters to integrate AI-driven dubbing into their workflows.

Shaping the Future of AI Dubbing

Dubformer’s leadership team consists of AI, machine translation, and media industry experts committed to transforming how content is localized. With their latest funding, the company is set to scale its operations and further enhance its AI capabilities, ensuring that dubbed media resonates emotionally with global audiences.

“In a rapidly evolving AI dubbing landscape, Dubformer is committed to pushing the industry forward by solving its biggest challenge—emotional authenticity,” said Dvorkovich. “By making AI dubbing feel more natural, we empower media companies to reach wider audiences while reducing localization costs, without compromising the viewer’s experience.”

With its groundbreaking technology and ambitious vision, Dubformer is well on its way to reshaping the future of media localization.

The post Dubformer Raises $3.6M to Revolutionize AI Dubbing with Emotion Transfer Technology appeared first on Unite.AI.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

Dubformer AI配音 Emotion Transfer 媒体本地化
相关文章