Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

AI summary

A project allows running llama.cpp on a jailbroken PS5 to natively execute any GGUF model on the console, starting with Qwen 3.8.

Key points

Hugging Face released 'Llama Windows', a free app allowing users to run local LLMs via the Windows 11 taskbar without commands.

Overview of Janas, a tool that executes large LLMs exceeding RAM capacity via SSD streaming, achieving faster inference than llama.cpp.

Microsoft experimentally integrated the llama.cpp LLM inference engine into Windows ML, its local AI inference foundation for Windows.

llama.cpp v0.6.0 was released, adding support for the new GLM-5.3-Flash model and Metal-based acceleration.

エージェント向けにハードウェア上で最大限の速度で動作する自己最適化推論エンジン「Magnitude」が発表され、llama.cppより最大2倍高速であるとされている