In the long run you’d imagine that GPUs will become more affordable once these massive datacenters have been built. At that point it becomes far more profitable to run your own hardware. Especially if these AI companies need to increase their subscription prices by x10 to finance all this debt they’ve taken on.
Yeah AI is here to stay but these “founder” companies sure aren’t.
Don’t worry, they are already talking loudly about how much more “dangerous” those on-premise models are and suggesting that regulation is needed to make sure people only rent it from trusted facilities that can manage it.
They make it so you cannot run some models yourself without government approval, based on some criteria. For a random citizen, this would be harder than trying to stop piracy, and thus those willing to ignore the technical law may continue however they like, but it would be enough to block businesses from doing so. Kind of like how some software has a license that is a trap for businesses to have to pay if employees end up using it, but is widely popular among consumers that can get and use it freely. So the home market can do whatever if they really want, but the businesses and products those businesses launch can’t ignore that sort of regulation so freely.
Another path is if they really get buy in that this is dangerous for mere peons to have: regulate hardware available for consumer purchase. Like no VRAM above 32GB, and nothing with the compute horsepower to go more than say 100 tok/s with a 32B model. Effectively setting a forever cap on home usage to current top-end ‘consumer’ and putting regulatory restrictions on beefier stuff. Consumer compute becomes just about improving power and cooling and form factor, no more expanding the capabilities beyond current top end.
In the long run you’d imagine that GPUs will become more affordable once these massive datacenters have been built. At that point it becomes far more profitable to run your own hardware. Especially if these AI companies need to increase their subscription prices by x10 to finance all this debt they’ve taken on.
Yeah AI is here to stay but these “founder” companies sure aren’t.
Don’t worry, they are already talking loudly about how much more “dangerous” those on-premise models are and suggesting that regulation is needed to make sure people only rent it from trusted facilities that can manage it.
They are certainly trying to kill local models and personal computing. I just don’t think it’s possible.
I see two ways this could happen:
They make it so you cannot run some models yourself without government approval, based on some criteria. For a random citizen, this would be harder than trying to stop piracy, and thus those willing to ignore the technical law may continue however they like, but it would be enough to block businesses from doing so. Kind of like how some software has a license that is a trap for businesses to have to pay if employees end up using it, but is widely popular among consumers that can get and use it freely. So the home market can do whatever if they really want, but the businesses and products those businesses launch can’t ignore that sort of regulation so freely.
Another path is if they really get buy in that this is dangerous for mere peons to have: regulate hardware available for consumer purchase. Like no VRAM above 32GB, and nothing with the compute horsepower to go more than say 100 tok/s with a 32B model. Effectively setting a forever cap on home usage to current top-end ‘consumer’ and putting regulatory restrictions on beefier stuff. Consumer compute becomes just about improving power and cooling and form factor, no more expanding the capabilities beyond current top end.