Show HN:我制作的AI配音工具,用来和我7岁的孩子一起看外语视频
Show HN: AI dub tool I made to watch foreign language videos with my 7-year-old

原始链接: https://speakz.ai

Introducing: Automatic Video Translator 一项名为“Speakz”的革命性新技术已经进入市场,它能够拍摄任何视频并以另一种语言生成全新的音轨,而无需改变扬声器的声音。 Speakz 使用尖端的人工智能算法,生成自然、真实的翻译,仔细平衡含义、个性和时机。 Speakz 是由开发人员 Jan Oleman 创建的,旨在帮助他更好地与女儿沟通,尽管他住在美国,但他主要用德语与女儿交谈。 通过建立一个将外国视频转换成母语的系统,他们可以一起欣赏精彩的内容,而无需互相翻译片段。 人们很快就发现,这项技术的应用范围远不止家庭娱乐。 目前支持的输出语言包括英语、中文、西班牙语、阿拉伯语、法语、俄语、德语、意大利语、韩语、波兰语和荷兰语。 同时,它还接受 80 多种其他语言的输入,包括印地语、孟加拉语、葡萄牙语和乌尔都语等。 平均而言,完成一份翻译所需的时间大约是原始视频片段所需时间的两倍。 世界各地的创作者和制作人组织都将从使用这一尖端技术平台中获益匪浅,特别是考虑到 YouTube 允许用户向其视频添加多个音轨。 在现有内容中添加多语言版本可以极大地增加收视潜力,从而有可能延长流行内容在未来几年的寿命和盈利能力。 同样,这个方便的新工具使世界各地的语言学生能够通过聆听专业口语翻译来学习特定的习语、词汇、发音细微差别,甚至语法规则,其准确性是大多数人类口译员无法比拟的。 感兴趣的各方可以通过加入候补名单在其网站上注册测试版,参与者可以在开发阶段获得所有特性和功能的独占访问权。 尽管具体的定价细节尚未确定,但一旦向消费者提供,用户应该会享受到与传统机器/人工口译服务类似的费率(大约每小时 5 美元)。 The Speakz software platform ensures high quality standards in every aspect, from technical precision down to ensuring a top-notch user experience. 简而言之,Speakz 提供了一个令人难以置信的解决方案,无论是学习第二语言的个人还是希望扩大全球受众群体的组织都受益匪浅——这一切都得益于人工智能驱动的先进计算机编程算法。

相关文章

原文

Translate your media across languages, keeping style, voice and ambient sounds.

Suggest A Sample

Frequently Asked Questions

How does this work?

Speakz takes a video in one language and generates a new audio track in another. All of which happens while preserving the original voices of the speakers, as well as other sounds or background music. Just like professionally dubbers, Speakz takes great care to balance meaning, personality and timing to produce natural, authentic translations.

Why did you make this?

I made it because I like watching great YouTube content with my 7-year-old daugther. We're German, but we love documentaries or channels like FrenchGuyCooking or theanatomylab. Being a developer, I thought it would be cool to make a tool that converts any video into German. This way, we don't have to constantly interrupt for me to translate, and we can talk about the content instead. As it turns out, having built this for German, it works for other languages as well.

What languages do you support?

For output, we currently support English, Mandarin Chinese, Spanish, Arabic, French, Russian, German, Italian, Korean, Polish and Dutch. For input, we additionally support Hindi, Bengali, Portuguese, Urdu, Indonesian, Japanese, Swahili, Marathi, Telugu, Turkish, Vietnamese, Tamil, Thai, Gujarati, Ukrainian, Persian, Romanian, Greek, Czech, Swedish, Hungarian, Belarusian, Azerbaijani, Slovak, Danish, Finnish, Norwegian, Hebrew, Malay, Serbian, Bulgarian, Croatian, Lithuanian, Slovenian, Latvian, Estonian, Galician, Armenian, Kazakh, Tagalog (Filipino), Macedonian, Bosnian, Welsh, Afrikaans, Icelandic, Maori, Nepali and Kannada.

How long does it take to translate a video?

I've translated videos from English to German manually in the past. It's usually been a job that takes several hours. Speakz is much faster. Right now, it takes about 2 times a video's length to generate one translation. That means a 30 minute video will take about an hour to process. However, I do see a path towards realtime translation and beyond, as well as streaming.

How can creators use this?

If you're a creator, you can use Speakz to reach more audiences with the content you already have. YouTube supports adding multiple audio tracks to your videos. So if your video is in English, if you add an audio track in Spanish, now your video will show up for Spanish-speaking audiences. With Speakz, you can easily add audio tracks in many languages, and you can do it automatically for all of your videos. If you are a creator and would like to learn more, please click here to join the private beta.

I'm not a creator. Can I use Speakz to translate videos I'd like to watch?

Sure! That's what I originally made it for. Members of my private beta will be able to generate translations for any video. You can select videos from YouTube, or you can upload your own. If you'd like to try it, please join the beta to get access.

Does it work for Podcasts?

Yes.

How much does it cost?

Pricing still is to be determined. But I imagine it'll be around $5 per hour per language. There likely will be discounts for translating the same video into many languages, as well as volume discounts for creators.

联系我们 contact @ memedata.com