水星 2.5
Mercury 2.5

原始链接: https://www.inceptionlabs.ai/blog/introducing-mercury-2-5

我们很高兴发布 **Mercury 2.5**,这是我们迄今为止性能最强的扩散模型(Diffusion LLM)。基于生产环境反馈和真实故障案例构建,它在保持行业领先的速度和效率的同时,实现了比 Mercury 2 高出 40% 的智能提升。 **主要特性:** * **性能:** 每秒 1,107 个 Token,支持 260K Token 上下文窗口。 * **经济性:** 起价为每百万输入 Token 0.04 美元(发布期间享有 80% 折扣)。 * **能力:** 具备可调推理、并行工具调用以及结构化 JSON 输出功能。 Mercury 2.5 专为搜索代理、语音交互和编程助手等对延迟敏感的应用场景设计,已显著降低了企业用户的成本并缩短了响应时间。 随此次发布,我们还预告了 **Mercury Voice**(针对 170 毫秒以内的低延迟进行了优化)和 **Mercury Router**(一种将查询路由至最适合任务模型的智能系统)。 Mercury 2.5 现已通过 Inception API、Baseten 和 OpenRouter 提供服务。我们正在开发下一代更大规模的模型,并将继续致力于推动基于扩散技术的语言模型发展。请访问我们的文档以开始使用或获取部署福利。

Hacker News 社区正在讨论 Inception Labs 发布的 Mercury 2.5 模型。该模型的独特之处在于其采用了基于扩散(diffusion-based)的架构,而非标准的下一个词预测(next-token prediction)架构。 讨论的主要要点包括: * **性能与速度:** 用户称赞该模型速度极快,这使其在实时语音代理等低延迟应用场景中极具吸引力。虽然它并非“前沿”模型,但被认为是一款功能强大且具有成本效益的通用聊天机器人。 * **架构:** 与典型的 LLM 不同,Mercury 可以一次性生成并去噪整页文本,开发者认为这一特性在技术上非常有趣。 * **局限性:** 批评者指出,与顶级模型相比,该模型在处理复杂的代理编码任务和工具调用方面仍显吃力。一些用户还对其未能开源权重表示失望。 * **应用场景:** 许多人认为,在延迟为关键制约因素的多模型系统中,它是高速子任务或“仲裁者”的有力候选者。 总的来说,尽管人们对它能否与领先模型竞争持怀疑态度,但社区认可它在推理成本和延迟为首要考量的商业环境中具有独特的价值。
相关文章

原文

Today, we’re releasing Mercury 2.5, our most capable production model yet. It is a significant step up in quality over Mercury 2, with the same low-latency, low-cost serving profile.

Since Mercury 2’s launch, thousands of developers have built with it, dozens of enterprises have put it into production, and usage has grown over an order of magnitude. It now serves latency-sensitive workloads across search, voice, and coding products.

Those workloads gave us a clearer signal than benchmarks alone. We used customer feedback and production failure cases to sharpen the evals and focus training. Mercury 2.5 is the first result of that loop.

What changed

Mercury 2.5 is the most capable diffusion LLM on the market. To our knowledge, it is the largest diffusion language model ever trained.

  • Quality: 40% increase in intelligence from Mercury 2. Comparable to cost-optimized frontier models like GPT-5.6 Luna (Low), Gemini 3.5 Flash-Lite, and Claude Haiku 4.5. 

  • Speed: 1,107 tokens per second on widely-available NVIDIA GPUs.

  • Context: 260K tokens.

  • Price: $0.20 per million input and $0.75 per million output.

    • At launch, Mercury 2.5 is 80% off at $0.04 per million input and $0.15 per million output.

  • Capabilities: Tunable reasoning, parallel tool calls, and schema-aligned JSON.

Speed BenchmarkMercury 2.5 vs Mercury 2.0

Since Mercury 2's launch, we've watched Inception advance diffusion-based language models further on NVIDIA AI infrastructure. Mercury 2.5's step up in intelligence paired with sustained speeds and low costs, reflects how quickly new architectures can mature into production-ready systems on the NVIDIA platform.

Shruti Koparkar, Senior Manager of Product, Accelerated Computing Group at NVIDIA

Mercury in production

Search Agents and RAG pipelines

One search request can trigger dozens of model calls: plan the search, rewrite queries, rerank results, structure facts, summarize sources, and check the answer. Mercury keeps those calls fast enough to stay inside a single user interaction. Several leading search-infrastructure companies now run it in production.

Query Rewrite Latency Benchmark

Voice agents and interactive applications

In voice, latency isn’t an infrastructure detail. It is the pause a caller hears.

OpenCall builds AI phone agents that handle live customer calls. On its production workload, Mercury brought median model response latency close to 170 milliseconds.

After we switched to Mercury, our P99 response time dropped from several minutes to just one second, and our P50 dropped from 0.4 seconds to under 0.2 — significantly faster than any other provider we’ve seen, and that’s including reasoning.

Oliver Silverstein, Co-founder and CEO, OpenCall

Coding subagents and assistants

Coding agents already split work across models. One may plan or write code while others search, run tools, route requests, summarize state, or compact a long session. Those supporting calls happen again and again, so latency and cost compound quickly.

Augment Code uses Mercury for context compaction, model routing, and MCP tool search. Moving compaction to Mercury cut latency by 82%, from roughly 150 seconds to 27 seconds, and reduced cost by 90% while maintaining quality. Tool-search summaries return in under a second.

The same speed applies to developing web apps. Watch Mercury 2.5 generate a working music discovery log web app from a few prompts in the demo below.

Mercury Voice and Mercury Router Preview

Alongside Mercury 2.5, we’re announcing a preview of Mercury Voice and Mercury Router. 

  • Mercury Voice delivers time-to-first-token (TTFT) under 170 milliseconds and is a dLLM optimized for voice agents with the tightest latency budgets. 

  • Mercury Router understands incoming prompts with a dLLM and routes them to the best models (open and closed models) that offer the best mix of quality, speed, and cost.

Get Started

Mercury models are available through our Inception API, Baseten, and OpenRouter. Enterprise deployments support dedicated capacity, autoscaling, compliance controls, and configurable data retention.

Try Mercury 2.5 in chat
Try the API with 100 million free tokens
· Read the API docs

  • Baseten customers: Deploy Mercury 2.5 through your existing Baseten setup.

  • Y Combinator companies: Claim $500,000 in deployment benefits.

  • Evaluating Mercury for voice? We’ll work with you to test workload fit, and validate performance under your serving constraints. Contact us.

What’s Next

We have already started training our next model. It is our largest model yet, and we are targeting a release in the coming months. Our next model will be a leap in capability without giving up diffusion’s speed and token-efficiency. That requires progress on model training, inference, evals, and infrastructure. If that's the kind of problem you want to work on, we’d love to hear from you.

More soon.

联系我们 contact @ memedata.com