• 0 Posts
  • 7 Comments
Joined 7 months ago
cake
Cake day: April 8th, 2026

help-circle




  • Monument@piefed.worldtoSelfhosted@lemmy.world•Is anyone self-hosting their own AI?
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    edit-2
    18 days ago

    I wouldn’t say I ‘run’ it, but I mess around with it

    I have a base level Mac Mini I got before the price increase a few years ago, also from when models were smaller and my ambitions were less. I’ve contemplated upgrading it, but I have other things to spend my money on.

    M4 processor, 16 gb ram, 256 gb storage, and a 4tb external HDD drive (an old NAS drive).

    It’s fine. It’s mostly a docker machine, but I do throw AI tasks at it a few times a week. Mostly stuff that I just let it chew on for 5-10 minutes and come back to.

    I run openwebui, and have several models I bounce between. I mostly run Gemma4 (Google) and Granite4.2:8B (IBM).

    Editing to add: the self hosted version of all these models, via llama, just in case that was unclear.


  • I know one single person who uses a Mac as a personal device that isn’t involved in some sort of deep internet technology field. He works in biotechnology and got tired of wasting time and effort on Windows problems.
    As for the rest? They use windows systems every day for work, where they’re often either fixing the internet or fixing people’s windows computers. They just prefer Mac for personal use.

    I’ve begun to feel like people who trash talk Mac users are the ones who aren’t technically capable - or at least not adaptable. I can fix almost any Mac or Windows issue, and can muddle through most *nix problems. I just don’t want that to be my identity. I got more important things to do.
    I’ve had the same MacBook Pro for 5 years now. I code on it, do graphic design, 3d model, play Steam games, and obviously use it as an internet device. It’s never given me a problem, and I imagine it’ll keep going for at least another 3-5 years. It’s fucking awesome, and “just works.”