双子座-3.5-转录
Gemini-3.5-Transcribe

原始链接: https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-5-transcribe/

Google 推出了其最先进的语音转文字模型 **Gemini 3.5 Transcribe**,专为高精度、智能化的语音交互而设计。该模型能直接将原始音频转换为润色、格式化后的文本,擅长过滤口语杂词、处理语音停顿,并能识别超过 85 种语言的专业术语。 该模型现已通过两个 API 向开发者提供: * **实时流式传输 (`gemini-3.5-transcribe-live`):** 为交互式语音代理提供亚秒级的低延迟响应。 * **预录处理 (`gemini-3.5-transcribe`):** 提供说话人识别和词级时间戳,适用于数据分析和会议记录。 Gemini 3.5 Transcribe 具备行业领先的准确性,在非流式任务中的字错率低至 2.6%,专为复杂的真实环境而构建。它还支持高级功能,例如通过函数调用进行任务委派,以及适应专业词汇的能力。无论是支持实时字幕生成还是复杂的通话后分析,该模型都为旨在构建更自然、更强大的语音驱动应用的开发者提供了一种稳健且无缝的解决方案。

关于 Google **Gemini-3.5-Transcribe** 的 Hacker News 讨论显示出截然不同的反馈。虽然许多用户认可该模型的准确性及其与 Google 生态系统(如 Gboard、Chrome 和 macOS)的深度集成,但也有人持怀疑态度,理由包括延迟问题、隐私顾虑以及 Google Cloud 计费流程带来的额外成本。 社区的主要观点包括: * **性能对比:** 用户将 Gemini 与 OpenAI 的 Whisper、Soniox 和 Voxtral 等现有模型进行了比较。尽管 Gemini 的准确性受到称赞,但用户常指出 Soniox 等竞争对手在对延迟要求极高的实时应用中表现更优。 * **“幻觉”挑战:** 所有语音转文字 (STT) 模型面临的共同痛点是模型出现“幻觉”或强制匹配词汇的倾向。许多开发者正在构建多阶段处理流程——先使用 Whisper 进行计时和基础转录,再通过大模型 (LLM) 进行校正,以实现高质量的输出。 * **集成阻碍:** 开发者批评 Google 的计费和账户审批流程过于繁琐,相比之下,OpenRouter 等替代方案更易于使用。 * **使用场景:** 讨论明确反映了用户群的分化,一边是优先考虑便捷性的“轻度”用户,另一边是需要在专业或商业环境中实现可靠多语言支持、说话人日志记录以及数据隐私的“资深”用户。
相关文章

原文

Today, we’re introducing Gemini 3.5 Transcribe, our most precise speech-to-text model yet, designed for intelligent voice interactions. Unlike conventional speech recognition models that struggle with background noise, complex jargon, and disfluency cleanup, Gemini 3.5 Transcribe converts raw audio directly into accurate, polished, formatted text.

Across our products like the Gemini app and on Android, we’ve seen consumers already benefiting from this transcription model with new voice capabilities like Rambler on Android and in the Gemini app on macOS. Now, developers can build similar capabilities with Gemini 3.5 Transcribe in the Gemini API in Google AI Studio and Gemini Enterprise Agent Platform.

We've built 3.5 Transcribe to plug seamlessly into your developer workflows, whether you’re building voice agents, real-time captioning tools, or post-call analytics pipelines. The model is available across two separate APIs:

  • Real-time streaming: Delivers continuous, bidirectional streaming with sub-second latency for interactive voice apps via the Live API using gemini-3.5-transcribe-live.
  • Pre-recorded audio processing: Transcribes recorded audio, meetings, call logs, and more with speaker attribution and word-level timestamps via the Interactions API using gemini-3.5-transcribe.

Gemini 3.5 Transcribe is designed to capture your natural speaking style to better understand your intent and recognize custom vocabulary, so you can execute tasks with your voice.

  • Smart transcription: Seamlessly handles self-corrections (like "let’s meet Tuesday—no, Wednesday"), removes filler words (“ums” and ‘“ahs"), auto-formats your text.
  • Function calling: The model can delegate complex tasks (such as image generation and file analysis) to other Gemini models via function calls. Currently available in the Gemini macOS app.
  • More precise transcription: As measured by Artificial Analysis, achieves an average Word Error Rate (WER) of 4.0% for streaming and 2.6% for non-streaming use-cases. It shows strong performance across noisy, real-world environments, accurately capturing alphanumeric entities like postal codes and order IDs.
  • Custom vocabulary: Recognizes specialized jargon and unique spellings by seamlessly adapting transcriptions to your provided custom vocabulary.
  • Global language support: Automatically detects and transcribes over 85 languages, seamlessly handling regional accents and diverse dialects.
  • Multi-speaker identification: Accurately attributes speech in pre-recorded audio with timestamps for up to three speakers (support for 3+ speakers is experimental).
联系我们 contact @ memedata.com