Llama.cpp 在越狱的 PS5 上:原生运行任意 GGUF 模型
Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

原始链接: https://github.com/cobanov/PS5LM

PS5LM 是一款自制应用,可将越狱的 PS5(固件 7.00–13.60)变成私有本地 LLM 服务器。它在终端的 RDNA 2 GPU 上运行 llama.cpp,最多使用 11.4 GB 共享内存,向网络中的任何设备提供 OpenAI 和 Anthropic 兼容 API 以及浏览器聊天界面,运行时无需 PC 或云。它支持 llama.cpp 已知的任何 GGUF 模型与架构,自动规划上下文/缓存以适配内存,并可从 Hugging Face 下载模型到内部、M.2 或 USB 存储。它还通过 /v1/systemone 运行 Ollaya 风格决策模型,在一次前向传播中返回类型化选项与概率,并支持视觉模型。TV 界面显示实时请求、终端状态(温度、功耗、GPU/CPU 负载)和诊断信息。设置需要 etaHEN、ShadowMountPlus 等 payload,可选 elfldr/ftpsrv;通过 FTP 复制应用后加载模型。性能范围从 Qwen 3.5 0.8B 的约 207 token/秒到更大模型的约 20 token/秒。采用 GPL-3.0-or-later 许可;与 Sony 无关联。

一篇Hacker News帖子介绍了一个在越狱PlayStation 5上运行Llama.cpp的项目,使GGUF模型可在主机上原生运行。该帖子有39点和5条评论。评论者开玩笑说AI模型正在扩散到各游戏主机,提到PlayStation 3集群,猜测索尼可能会对此类用途收费,并指出PS5的11.4GB共享内存在无GPU时也可能很有用。页面还包含一条Y Combinator申请广告。
相关文章

原文

PS5LM

Your PS5 runs the language model. Every device on your network uses it.
llama.cpp on the console's GPU, with OpenAI and Anthropic APIs and a screen made for the TV.

Get the app · Website · Get started · Issues

New: decision models, powered by Ollaya. PS5LM now runs Jev-like decision models (d1, Clef, OpenJev and more) on the GPU and answers the same /v1/systemone API as Ollaya: typed decisions with calibrated probabilities, in a fraction of a second.

PS5LM is for anyone with a jailbroken PS5 who wants a private model server at home. It loads a GGUF model onto the console's GPU and serves it to your laptop, your phone and your coding tools. It needs no PC while it runs, no cloud and no account.

Qwen 3.5 9B generating on a PS5, with the requests streaming across the TV
Qwen 3.5 9B answering requests from a laptop on a PS5 Slim. Click for the video.

Home: the model, its speed and the live requests Models: the ones suggested for the PS5 Home with a decision model Console: temperature, power and load over time API: the endpoints and an example Settings: a list of choices under the row
Home, Models, Console, API and Settings on the TV.

A model server under your TV

  • It runs on the GPU. llama.cpp's Vulkan backend on the console's RDNA 2 GPU, with 11.4 GB of the shared memory for the model and its context. Every architecture and quantization llama.cpp knows comes along.
  • It answers your network. OpenAI's /v1/chat/completions, Anthropic's /v1/messages (Claude Code works against it) and a chat page in any browser. Point a client at http://<console>:8081 and use any model name: the loaded one answers.
  • It decides, too. Load a decision model and the console answers TypeSafe's /v1/systemone: choice, score and yes-or-no questions about text and images, the API Ollaya serves on a PC.
  • It shows its work. Every request streams across the TV as a chat: which device asked, what it asked, and the reply as it is written. Square sends a demo and Triangle opens a keyboard, so the console can be tried from the couch.
  • It watches the console. A Console page charts temperature, power, GPU and CPU load over the last two minutes or the last hour, beside a table of every reading.
  • It picks what fits. The planner reads each GGUF and gives it the longest context and best cache that fit the memory free. A Suggested list holds models measured on the console, and the app downloads from Hugging Face by itself, to internal storage, the M.2 drive or a USB drive.
  • It reads images. Models with an image projector (Gemma 4, MiniCPM-V, d1) take pictures in chat and in decisions.
Model Size On a PS5 Slim
Qwen 3.5 0.8B, Q4_K_M 0.5 GB 207 tokens a second
Qwen 3.5 9B, Q4_K_M 5.3 GB 55 tokens a second
Qwen 3.8 27B, UD-Q2_K_XL 9.2 GB about 20 tokens a second, 64k context
d1 Omni 600M, a decision model 1.1 GB 3 questions in 0.3 s; a 720p image and 7 questions in 2.9 s

Decision models, powered by Ollaya

Ollaya runs open decision models on a PC the way Ollama runs language models. PS5LM brings the same idea to the console: a decision model reads a state and answers typed questions in one forward pass, with no text generated.

curl http://<console>:8081/v1/systemone -H 'Content-Type: application/json' -d '{
  "state": "I was charged twice this month. Refund me or I cancel.",
  "questions": {
    "intent": {"type": "choice", "instructions": "What does the customer want?",
               "criteria": {"refund": null, "information": null, "cancel": null}},
    "angry":  {"type": "noul", "instructions": "Is the customer angry?"}
  }
}'

The Suggested list has d1 Omni 600M, d1 3B and Clef Flash. Any GGUF that carries llama.cpp's decision metadata loads the same way, and the app labels it a decision model.

You need a PS5 on firmware 7.00 to 13.60, jailbroken, with these payloads loaded:

Payload For
kstuff-lite the kernel patches homebrew runs on required
etaHEN homebrew support required
ShadowMountPlus puts PS5LM on the home screen from /data/homebrew required
elfldr (port 9021) temperature, power and real free space, through ps5-exporter recommended
ftpsrv (port 2121) installing the app, copying models from a PC recommended
  1. Download ps5lm-app-vX.Y.Z.zip from the latest release and unzip it.
  2. Copy the PPSA99575 folder to /data/homebrew over FTP. ShadowMountPlus adds PS5LM to the home screen.
  3. Open PS5LM, go to Models > Suggested and get a model. Or copy a .gguf to /data/PS5LM/models, or to PS5LM/models on a USB drive.
  4. Load it. Once Home says Ready, open http://<console>:8081 in a browser, or point your OpenAI or Anthropic client at it.

To update, copy the new folder over the old one. Settings, models and downloads stay in /data/PS5LM. Using it from coding tools (opencode, Codex, Claude Code) is in docs/CLI.md.

Where Button Does
Everywhere L1 / R1 Home, Models, API, Console, Settings
Home Cross change the model
Home Square / Triangle send a demo request / type a message
Models D-pad, Cross choose a section and a model; load, unload or download it
Models, Search L2 / R2, Square change the search; check whether a file fits
Models, Downloads Cross, Square pause or resume; cancel (press twice) or clear
Console L2 / R2 the last two minutes / the last hour
Settings D-pad, Cross choose a category and a row; flip it, or pick from its list
Settings, Diagnostics Square, Triangle app or server log; errors only

C++ on ps5-homebrew-ui, llama.cpp with ggml-vulkan on PS5_Vulkan's RADV, built on Linux.

Building · Console notes · Porting · Research · Models that fit · Roadmap · Changelog · The original payload


GPL-3.0-or-later, see LICENSE. llama.cpp keeps its MIT licence, Manrope its OFL. No Sony SDK files, keys, firmware or model weights are in this repository.

PS5LM is not affiliated with Sony Interactive Entertainment. "PlayStation" and "PS5" are trademarks of Sony Interactive Entertainment.

联系我们 contact @ memedata.com