eicker@lemmy.world to Technology@lemmy.worldEnglish · 7 days agoSam Altman Absolutely Hates the Idea of People Running Their Own AI Models at Home, Argues They Shouldn’t Own Computers: He'd prefer if we surrender all our RAM to data centers.futurism.comexternal-linkmessage-square364linkfedilinkarrow-up11.38Karrow-down118
arrow-up11.36Karrow-down1external-linkSam Altman Absolutely Hates the Idea of People Running Their Own AI Models at Home, Argues They Shouldn’t Own Computers: He'd prefer if we surrender all our RAM to data centers.futurism.comeicker@lemmy.world to Technology@lemmy.worldEnglish · 7 days agomessage-square364linkfedilink
minus-squarecheesorist@lemmy.worldlinkfedilinkEnglisharrow-up2·7 days agoi have a similar build except with a 9070xt, running 64k context window how well is 256k window working for you? also which model did you pick? i picked swift 1.5 iq3 xxs
minus-squareFlexibleToast@lemmy.worldlinkfedilinkEnglisharrow-up2·7 days agoThe 256k works great. I think I picked the 2 iq3s. Edit: I realize I typoed my last post. I have a 7900XT not a 7800XT. That 4GB more of vram might matter.
i have a similar build except with a 9070xt, running 64k context window
how well is 256k window working for you?
also which model did you pick? i picked swift 1.5 iq3 xxs
The 256k works great. I think I picked the 2 iq3s.
Edit: I realize I typoed my last post. I have a 7900XT not a 7800XT. That 4GB more of vram might matter.