Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

Your PS5 runs the language model. Every device on your network uses it. llama.cpp on the console's GPU, with OpenAI and Anthropic APIs and a screen made for the TV.

New: decision models, powered by Ollaya. PS5LM now runs Jev-like decision models (d1, Clef, OpenJev and more) on the GPU and answers the same /v1/systemone API as Ollaya: typed decisions with calibrated probabilities, in a fraction of a second.

PS5LM is for anyone with a jailbroken PS5 who wants a private model server at home. It loads a GGUF model onto the console's GPU and serves it to your laptop, your phone and your coding tools. It needs no PC while it runs, no cloud and no account.

Qwen 3.5 9B answering requests from a laptop on a PS5 Slim. Click for the video.