Meta Muse Glimmer – 30B 开源权重本地编程模型
Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

原始链接: https://research.meta.ai/blog/introducing-muse-glimmer-open-agentic-model

Meta Superintelligence Labs 发布了 **Muse Glimmer**,这是一款拥有 300 亿参数的模型,专门针对全天候运行的本地智能体(agent)工作流进行了优化。该模型采用 Apache 2.0 许可证发布,旨在能在 Mac 或配备单显卡的 PC 等消费级硬件上高效运行。 主要功能包括: * **智能体能力:** 在多步推理、精准工具调用、故障恢复和多模态输入处理方面表现卓越。 * **优化:** 通过先进的量化技术和推测解码(使用 DFlash“起草”模型),Muse Glimmer 可在 24–32 GB 内存范围内运行,同时保持极高的生成速度。 * **性能:** 在智能体基准测试(如 SWE-Bench、𝛕-Bench)中表现优异,并支持超过 100 种语言。 * **易用性:** 该模型现已在 Hugging Face 上线。Meta 确保了其与 `llama.cpp`、MLX 和 ExecuTorch 等主流框架的兼容性,使开发者能够构建并部署无需依赖云端或互联网的本地化私有智能体。 通过开源 Muse Glimmer,Meta 旨在赋能社区,助力构建完全在设备上运行、响应迅速、具备隐私保护且具有上下文感知能力的智能体。

**摘要:Muse Glimmer 与本地大模型的现状** **Muse Glimmer** 是一款针对全天候本地智能体工作流优化的 30B 参数模型,其发布在 Hacker News 上引发了热烈讨论。用户正在将其与 Qwen 3.6 27B 等现有模型进行性能对比,初步印象显示,该模型在编程和智能体任务方面表现出色,并因其“简洁高效”的推理过程而受到关注。 讨论的主要议题包括: * **竞争性的发布时机:** 观察人士推测 Meta 的发布时间表受到即将发布的 Qwen 3.8 影响;企业往往通过“蚕食”竞争对手的新闻周期来保持自身热度。 * **本地 AI 复兴:** 一个主要讨论点是从依赖云端 API 向“桌下服务器”部署的转变。尽管本地托管具有隐私和成本优势,但用户也承认存在重大障碍,包括高昂的硬件成本(显存需求)以及高效本地推理的高学习曲线。 * **“开放权重”之争:** 社区持续区分“开放权重”(Meta 的做法)与“开源”。虽然一些人将这些发布视为对自由开源软件(FOSS)生态的馈赠,但另一些人仍对 Meta 的企业历史持批评态度,认为模型发布是旨在挽回开发者信任的公关手段。
相关文章

原文

Today, we're introducing Muse Glimmer, the next model from Meta Superintelligence Labs, and open sourcing the model weights under a permissive Apache 2.0 license.

Muse Glimmer is a 30-billion-parameter model optimized for always-on local agent workflows. It’s small enough to run on a Mac or PC with a single consumer GPU, enabling use cases that range from local agents and function calling, to local coding, and LLM-as-a-judge evaluation. Muse Glimmer delivers strong performance on key agentic use cases and benchmarks compared with leading models in its size category.

Foundation models have achieved remarkable capabilities across reasoning, code generation, and tool use — yet most deployments still depend on cloud infrastructure and network access. Running models locally enables you to use AI anywhere, anytime, with or without an internet connection. This is increasingly viable: the open source community has shown that smaller models, when trained effectively, can approach frontier-level performance on targeted tasks. Muse Glimmer is optimized for these local use cases.

Keeping with our long tradition of sharing fundamental AI research, we're releasing Muse Glimmer open weights today on Hugging Face, along with developer documentation to help you start building and running your own agents. Muse Glimmer is built to work with the tools developers already use. Optimized integrations on llama.cpp, MLX, and ExecuTorch will land in the coming days, so you can go from download to working agent in minutes.

How We Trained Muse Glimmer

An agent that manages your schedule, drafts your messages, organizes your files, and learns how you work needs deep access to personal context. It also needs several capabilities working in concert: long-horizon execution, precise tool calling, multimodal understanding, long-context memory, and instruction following.

We designed Muse Glimmer to balance capability against the memory and compute constraints of local hardware. This required a compact architecture, a novel distillation recipe that transfers agentic reasoning from a much larger teacher model, and inference optimizations — including quantization — to meet latency expectations. We achieved this in the following phases:

  • Pre-Training. We trained Muse Glimmer on Muse Spark's outputs using logit distillation, leveraging a similar data mix as the teacher.
  • Mid-Training. We trained the model on longer-context, more agent-heavy data with richer reasoning traces, alongside organic data.
  • Post-Training. We combined supervised fine-tuning with a mix of on-policy distillation and reinforcement learning across general, reasoning, coding, and agentic domains.

Muse Glimmer was evaluated under the standards set out in Meta's Advanced AI Scaling Framework and assessed for open-weight release across all relevant categories.

Built for Agents: What Muse Glimmer Can Do

Building effective agents requires key capabilities working together to achieve the user’s goals. Muse Glimmer is trained and evaluated across each of the following:

  • End-to-end Agentic Task Completion. Muse Glimmer achieves strong success rates on full-task benchmarks including DeepSearch QA, MCP-Atlas, 𝛕-Bench and SWE-Bench, which measure its ability to work within scaffolds, write and debug code, and resolve multi-turn requests from start to finish.
  • Reliable Tool Use. The model handles a wide range of function calls, invoking tools with precise schemas throughout extended workflows.
  • Multi-Step Reasoning. Muse Glimmer chains reasoning over long horizons, sustaining coherent plans across complex, extended workflows.
  • Failure Recovery. When a tool call fails or returns an unexpected result, the model is trained to diagnose the error and retry rather than halt.
  • Multimodal Input and Reasoning. Through a dedicated perception encoder, the model accepts interleaved text and images. This enables agents to interpret screenshots, charts, and documents alongside conversation.
  • Scaffold Compatibility. Muse Glimmer works across OpenClaw and other agentic orchestration patterns.
  • Controllable Effort. Muse Glimmer supports different reasoning strengths to select the right balance between quality and speed.
  • Multilingual. Muse Glimmer is trained on data from more than 100 languages.

Performance

We evaluated Muse Glimmer across a broad range of benchmarks to assess the diverse capabilities required for effective autonomous agent behavior. Compared with Gemma4-31B and Qwen3.6-27B, Muse Glimmer performs strongly for its size class on several widely used LLM benchmarks.

For more detail about our evaluations, see our report.

Optimized for Local Deployments

A local agent is truly useful if it's fast enough to feel responsive. An agent that takes minutes to reply or plan its next step breaks the flow of real work. We applied two optimizations to make Muse Glimmer run at practical speeds on consumer hardware without sacrificing quality.

Fitting the Model on Your Device.

At full precision, a 30-billion parameter model would require over 55 GB of memory — far more than any consumer GPU offers. We use quantization techniques to compress the model's weights to approximately 4-bit precision, shrinking the language model to under 20 GB. This leaves enough headroom for the model's working memory (its "KV cache"), the perception encoder for image understanding, and the speculative decoding drafter to run simultaneously within a 24 GB or 32 GB envelope. We validated that this compression introduces minimal to no degradation on agentic tasks.

Faster Generation Through Speculative Decoding.

Language models normally generate text one token at a time, which can feel slow during long reasoning chains or multi-step tool calls. Muse Glimmer ships with a lightweight "drafter" model based on DFlash — a small companion network that proposes entire blocks of tokens at once. The main model then verifies these proposals in parallel, accepting correct tokens and correcting wrong ones. This technique lets Muse Glimmer generate text significantly faster than standard token-by-token generation while producing identical output quality. We provide quantized drafter versions to incur a smaller memory overhead in the release.

The Result:

We measure the speed of our K-Quant-17GB model alongside the quantized DFlash drafter on MacBook M4-Max, M5-Max and on a RTX-5090. The model is fast enough for fluid conversation and real-time agent interaction, all running entirely on your device.

Get Started With Muse Glimmer Today

Muse Glimmer is available now, and you can download the weights on Hugging Face. In the coming days, run it locally through partners like Ollama, LM Studio, and Unsloth, deploy it with edge frameworks including llama.cpp, ExecuTorch, and MLX, serve it at scale with vLLM and SGLang, or get started quickly through partners like Together AI, Fireworks AI, and OpenRouter. You can even customize it for your use-case by leveraging PyTorch’s TorchTitan training feature to customize the model further.

We're also working with our partners including AMD, Arm, Dell, Intel, and NVIDIA to optimize performance across devices. In addition, we’re releasing documentation so developers have the resources they need to get started and build responsibly with Muse Glimmer. This includes guidance on setting up custom scaffolds, so it's even easier to start building and deploying personal agents on day one. You can learn more and find resources to build on Meta's AI Developer Center.

This work builds on Meta's long track record of open AI research, extending it into agentic AI and giving developers access to local agentic capabilities. As always, we welcome feedback from the community and can’t wait to see what developers build with this open weights model.

Download the Model on HuggingFace Developer Documentation
联系我们 contact @ memedata.com