Inception “Mercury 3”,1000 tok/s 扩散大语言模型
Mercury 3: Diffusion at scale

原始链接: https://www.inceptionlabs.ai/blog/introducing-mercury-3

Mercury 3 是一种新的基于扩散的 LLM,声称在运行速度比 GPT-6 Luna 和 Claude Haiku 5.5 快 4–8 倍、达到每秒 1,068 个 token 的同时,性能优于它们。它显著扩展了扩散规模:比 Mercury 1 大 40 倍以上,智能提升约 3 倍,并支持 100 万 token 的上下文窗口。定价为每百万输入 token 0.20 美元、每百万输出 token 0.70 美元,提供 50% 的发布折扣和缓存输入 token 90% 的折扣。早期合作伙伴将它用于浏览器代理、辅导、搜索和客户支持,称其低延迟和质量强。它可通过 Inception API、OpenRouter、Baseten 和 Vercel 获取,提供 OpenAI 兼容端点和企业选项。配套产品包括 Mercury Voice 和 Mercury Decide。

Inception 推出了 Mercury 3,这是一个生产级扩散 LLM,能够并行生成 token,而不是一次生成一个。公司声称,在同等推理强度下,它在几项基准测试中优于 GPT-6 Luna 和 Claude Haiku 5.5,在 NVIDIA Blackwell GPU 上速度超过每秒 1,000 个 token,支持 100 万 token 上下文,发布时输入 token 每百万 $0.10、输出 token 每百万 $0.35,并提供 1 亿免费 token。Inception 表示扩散可扩展,且自 Mercury 1 以来模型参数增长超过 40 倍,同时保持速度。 早期用户报告其在编码和原型开发方面表现强劲,尤其是子代理风格任务,但实际速度往往低于标题宣称,且首 token 延迟可能更慢。该模型不是开放权重,但可通过 Inception 的 API、OpenRouter、Baseten 和 Vercel 获取。讨论还涉及 Google 此前的扩散努力以及可能的批处理/规模限制。总体而言,Mercury 3 被视为面向速度敏感用例的有前景、非常快且更低成本的选择,但尚未达到顶尖前沿模型的水平。
相关文章

原文

Today we’re introducing Mercury 3, the most capable diffusion-based LLM released to date. Across a range of benchmarks, Mercury 3 outperforms GPT-6 Luna and Claude Haiku 5.5, while running 4–8x faster at 1,000+ tokens per second.

Mercury 3 demonstrates that text diffusion scales. It’s more than 40x larger than Mercury 1 and is vastly more intelligent, but just as fast.

Intelligence vs. model size

Early-access partners already use Mercury 3 for voice and chat support, real-time tutoring, data engineering, and web navigation:

Mercury 3 at a glance

  • Quality: On par or better than frontier speed-optimized models like GPT-6 Luna and Claude Haiku 5.5.

  • Speed: 1,068 tokens per second on NVIDIA GPUs. 

  • Context: 1M tokens, up from 260K for Mercury 2.5

  • Price: $0.20 per million input and $0.70 per million output tokens.

    • At launch, Mercury 3 is 50% off at $0.10 per 1M input and $0.35 per 1M output. Cached tokens are 90% off the input price.

Mercury 3 benchmark results

Diffusion at scale

When we launched Mercury 1, it was the first proof point that diffusion LLMs could be built for commercial applications. The open question in the AI community was whether diffusion LLMs could scale to compete with autoregressive models on complex use cases.

Mercury 3 answers that question: they can. We’ve scaled Mercury more than 40x in total parameters, and intelligence across a range of standard benchmarks has risen 3x from Mercury 1 (mini) to Mercury 3. The scaling laws that drove progress in autoregressive models hold for diffusion too.

Intelligence vs. model size

Mercury 3 in production

Early-access partners are already running Mercury 3 to power latency-sensitive applications such as browser use agents, interactive education, real-time search agents, and customer support.

Browser Use Agents

Agents wait on the model at every step, so small delays compound quickly. Mercury keeps each pass fast, whether the agent is navigating websites, researching across sources, or analyzing logs and tracing incidents. Agents finish sooner and have time to try more approaches before answering.

We ran Mercury 3 inside our production web-agent harness against frontier models, on 50 live Mind2Web navigation tasks. Mercury 3 completed 50% of them, significantly more than GPT-6.1-Sol. It did so using the same token volume and the same number of agent steps as a frontier model, at a fraction of the per-token cost.

Shuhao Zhang, Cofounder, TinyFish AI

Interactive Education

Learning runs on fast feedback loops, and any delay pulls a student out of the material. Mercury reasons through each request and responds in near real time, whether it’s a voice tutor carrying a conversation, an assistant grading work, or an app adapting the next question to what the student just got wrong.

Mercury 3 allowed us to give every student instant feedback without giving up reasoning. Hints, marked answers and definitions now come back in about a second, with quality as good as or better than the models we ran before. When a student is stuck on a question, that speed keeps them working instead of waiting, and it was a drop-in swap for our existing stack.

Michael Tong, Co-founder/CTO, General Learning aka RevisionDojo

Real-time search agents

Search applications start to feel unresponsive after just a few seconds delay. Mercury 3 runs fast enough to process dozens of documents and still answer while the user is engaged.

On smart glasses, an answer that takes five seconds feels broken. In our Sense API tests, Octen search took about 80ms; model generation was the bottleneck. Mercury 3 delivered the best balance of speed and quality among the fast models we tested, with a median generation time of 0.9 seconds and a median end-to-end response time of 2.2 seconds.

Kuan Zou, Founder & CEO, Octen AI

Customer support

Support agents have to answer quickly, often for regulated businesses where a wrong answer is costly. Mercury keeps responses conversational without sacrificing accuracy.

At Lorikeet, we help complex and regulated businesses build a concierge for their customers that works across voice, chat and email. In chat and voice, customers need fast responses, but we can't compromise on accuracy or getting the job done correctly. In early testing, Mercury 3 beat other models on latency while also performing higher on evals and in production.

Michael Gribben, Member of Technical Staff, Lorikeet

A real-time product portfolio

Mercury 3 is the flagship model in a widening portfolio of products that enable real-time AI.

  • Mercury Voice: Mercury Voice is customized for the extreme low-latency requirements of voice applications and for minimizing time to first answer token (TTFAT), not just end-to-end latency. It’s already powering agents at Audivi AI, Altur, and OpenCall. 

  • Mercury Decide: Mercury Decide is a decision model built for high-volume classification. It outperforms Jev on benchmarks including JevBench and LegalBench.

Get started

Mercury 3 is available today on the Inception API Platform and through OpenRouter, Baseten, and Vercel. It is OpenAI API compatible, so it drops into your existing stack with no rewrites. Enterprise deployments support dedicated capacity, autoscaling, compliance controls, and configurable data retention.

Mercury 3 is live. Diffusion scales.

联系我们 contact @ memedata.com