I’ve been meaning to try the GLM line on my GX10 pair. Maybe this weekend I’ll see about getting it going.

Tho the 0731 works pretty well with SillyTavern and is not half bad with yaml and ansible playbooks.

But I will be giving the GLM a spin and see how it is.

I’m glad I have 2 ASUS GX10 devices connected together. Runs DeepSeek 0731 beautifully at 128K context even.

I also have 2 M4 Pro with 24GB each that run smaller utility LLM’s.

Hardware

2 x ASUS GX10 128GB(each)

2 x Mac Mini M4 Pro 24GB(each)

The GX10s are clustered and run DeepSeek-V4-Flash-0731-Abliterated. The M4 Pros run various utility LLMs such as Qwen 3.8

I have the following software running

OpenWebUI

Hermes Agent

LiteLLM

Llama.cpp

vLLM

StoryBinder - custom web app that I use for story/script writing when in the mood

LASM - Local AI Stack Manger - custom web interface to manage pretty much all aspects of my local stack. Agents run on the 4 nodes as well as my NAS(Download GGUF/HF snapshots once and copy out to the nodes)

Have yet to connect my Home Assistant into the stack.

For mobile access I use Conduit https://github.com/cogwheel0/conduit