Unc among uncs.

  • 0 Posts
  • 37 Comments
Joined 3 years ago
cake
Cake day: June 29th, 2023

help-circle
















  • I’m also impressed with GLM-5.3-Flash. This is similar to Claude Opus 4.8. It’s much smaller and cheaper than GLM-5.3, and still incredibly capable. It’s also actually feasible for an individual person to get hardware to run it, like if you can one day get your hands on a Mac Studio with 512GB of RAM.

    512 GB of RAM?!

    My brother in christ I don’t even have 12 GB of ram! I don’t even have 512GB of SSD storage!



  • … Why the fuck is there telemetry on my local AI?? I tried Qwen3.5:2b

    spoiler
    slot launch_slot_: id  0 | task 17 | processing task, is_child = 0
    slot   operator(): id  0 | task 17 | new prompt, n_ctx_slot = 8192, n_keep = 4, task.n_tokens = 439
    slot   operator(): id  0 | task 17 | cached n_tokens = 258, memory_seq_rm [258, end)
    slot init_sampler: id  0 | task 17 | init sampler, took 0.15 ms, tokens: text = 439, total = 439
    [GIN] 2026/10/11 - 16:08:03 | 200 |     324.081µs |       127.0.0.1 | GET      "/api/ps"
    [GIN] 2026/10/11 - 16:08:03 | 200 |       71.38µs |       127.0.0.1 | GET      "/api/ps"
    [GIN] 2026/10/11 - 16:08:03 | 200 |     164.616µs |       127.0.0.1 | GET      "/api/ps"
    [GIN] 2026/10/11 - 16:08:03 | 200 |      96.902µs |       127.0.0.1 | GET      "/api/ps"
    [GIN] 2026/10/11 - 16:08:04 | 200 |      64.533µs |       127.0.0.1 | GET      "/api/ps"
    time=2026-10-11T16:08:04.525-03:00 level=WARN source=types.go:1035 msg="invalid option provided" option=_capturingTokenCorrelationId
    time=2026-10-11T16:08:04.530-03:00 level=WARN source=types.go:1035 msg="invalid option provided" option=_otelTraceContext
    time=2026-10-11T16:08:04.530-03:00 level=WARN source=types.go:1035 msg="invalid option provided" option=_telemetryTurn
    [GIN] 2026/10/11 - 16:08:04 | 200 |  105.201776ms |       127.0.0.1 | GET      "/api/ps"
    time=2026-10-11T16:08:04.801-03:00 level=INFO source=sched.go:1338 msg="updated VRAM based on existing loaded models" gpu=0 library=Vulkan total="2.2 GiB" available="2.2 GiB"