• 0 Posts
  • 14 Comments
Joined 3 years ago
cake
Cake day: January 16th, 2024

help-circle





  • JasonDJ@lemmy.ziptoSelfhosted@lemmy.world•Is anyone self-hosting their own AI?
    link
    fedilink
    English
    arrow-up
    26
    arrow-down
    2
    ·
    16 days ago

    What a timely comment.

    I recently gave my kid a gaming PC for his birthday…which I used as an excuse to upgrade my GPU from a 1660 Super to a 5060ti 16GB

    Combined with a 5600x3d and 32gb of system memory.

    I just started messing with local LLMs yesterday. “Getting started” is rather easy. pacman -S lm-studio (I use arch, btw), launch it, download a model that your hardware supports, and start talking.

    Right now I’m working on getting it to talk to vscode.




  • Router is a bunch of old PCs I frankensteined and put opnsense on.

    Ended up i5-7500, 8gb mem, 500gb SSD.

    Put in a dual-port SFP+ NIC and a dual port 2.5GbaseT nic.

    One of the 2.5gb ports goes to my cable modem.

    One of the 10gb ports takes Twinax to my dumb LAN switch, the other to my dumb server switch, which right now is really just my storage network…the link to the firewall isn’t doing anytuhing.

    The dumb switches I have here, though, they’ve got some sort of weird MAC learning disability. It cannot handle macflaps, which I found out about because I had a hard time roaming between APs.

    So I got a Netgear GS108T and put OpenWRT on it, and that switches between my APs.

    My APs are Linksys MX4200v1’s. Also openwrt. Got four of them…one upstairs, two in the ground floor, one in the basement. Can get very close to 1Gbps anywhere in the house on wifi. Not the best platform for openwrt (ipq807x), as I’ve found out…but it was a hella cheap deal for tri-band AX APs.





  • When I search for things at work, and reddit may have the top result, I stopped clicking them becasue they want me to log in.

    When I search for things on my phone, and reddit is one of the top results, I stopped clicking it because now it won’t let me read it in browser, and forces me to use their app.

    They got rid of old reddit.

    Clearly they are trying to pad their logged-in user counts.

    I’m done. I’m sorry to say that I’d rather have an AI-generated answer (that likely is citing the right answer on reddit anyway) than to give reddit the satisfaction of making me open their app or log in.

    Fuck them.

    Fuck spez.

    RIP AaronSw.


  • Not to be pro-corporate/anti-repair…but I feel I have to play devils-advocate here…

    That sounds like a legal and security nightmare.

    If you just give binary blobs and no sources, there’s no way to maintain the code/device long term. As exploits continue to be found in upstream dependencies, the hardware continues to become increasingly insecure.

    But if the source needs to be released…I imagine that there are heaps of proprietary code that is still in use on “active” devices even after another model goes EoL…so if that code is released, there’s instantly thousands of nefarious eyes on it.

    On top of the regular zero-days that are found out when a popular product reaches EoL.

    I think that’s potentially a lot to ask of users. Will your technically-challenged great-Aunt switch to post-support build when her phone hits EoL, or will hackers be able to remote control her banking app and take away your inheritance before the community can even patch it (assuming there’s enough community support out there for an 8-year-old Galaxy A-series…)

    Then there could also be licensed code that would need to be released as well…hence the legal nightmare.

    Not saying it’s impossible…in fact, I greatly agree with your stance and stated position. Just saying that there are some blockers on this epic.