return2ozma@lemmy.world to Technology@lemmy.worldEnglish · 3 days agoApple has new Mac app coming to make running local AI models easy9to5mac.comexternal-linkmessage-square25linkfedilinkarrow-up1111arrow-down124
arrow-up187arrow-down1external-linkApple has new Mac app coming to make running local AI models easy9to5mac.comreturn2ozma@lemmy.world to Technology@lemmy.worldEnglish · 3 days agomessage-square25linkfedilink
minus-squaresetsubyou@lemmy.worldlinkfedilinkEnglisharrow-up1·3 days agoI guess vLLM supports clusters so you could just use that? The setup is more difficult than just plugging in a cable though.
I guess vLLM supports clusters so you could just use that? The setup is more difficult than just plugging in a cable though.