• 0 Posts
  • 33 Comments
Joined 3 years ago
cake
Cake day: June 16th, 2023

help-circle

  • I see two ways this could happen:

    They make it so you cannot run some models yourself without government approval, based on some criteria. For a random citizen, this would be harder than trying to stop piracy, and thus those willing to ignore the technical law may continue however they like, but it would be enough to block businesses from doing so. Kind of like how some software has a license that is a trap for businesses to have to pay if employees end up using it, but is widely popular among consumers that can get and use it freely. So the home market can do whatever if they really want, but the businesses and products those businesses launch can’t ignore that sort of regulation so freely.

    Another path is if they really get buy in that this is dangerous for mere peons to have: regulate hardware available for consumer purchase. Like no VRAM above 32GB, and nothing with the compute horsepower to go more than say 100 tok/s with a 32B model. Effectively setting a forever cap on home usage to current top-end ‘consumer’ and putting regulatory restrictions on beefier stuff. Consumer compute becomes just about improving power and cooling and form factor, no more expanding the capabilities beyond current top end.




  • Add to this that incremental improvement comes at exponentially more and more cost. So they spend ungodly amounts more in hopes that the next incremental improvement will push them over the magic line beyond where the are.

    Some impressive feats but the issues holding it back from the ‘replace the whole economy’ sort of ambition they imagine are very stubborn. Notably it still confidently declares incorrect information (a significant volume of software developement works around by rigging auto-retries until it stumbles into ‘correctness’, and of course the people pumping out slop art/books aren’t bound by ‘correctness’) and they still have no clear path to autonomous control of humanoid robotics (as crazy advanced as the online GenAI experience, they are still struggling to demonstrate even the most basic manual labor tasks).






  • This has strayed quite a bit from the assertion that there can’t be enduring problems in the current crop of AI investment because it was at a high a while back.

    But to continue, if you invested in the makeup of the DJIA in 1929 and left it in those companies, you would not be having a particularly good time.

    If you kept refreshing the investment in the companies deemed to be the ‘good’ ones over time, then yes, your investment fared well, but that says nothing about the enduring value of the companies that made up the index in 1929. This is the current topic. It’s also wild to be this dismissive of the Great Depression as nothing to worry about because, eventually, we decided on a new set of lines that could go up.

    So “line goes up” by definition is not really an endorsement that all companies lines go up, we shift the criteria over time to make sure that we measure whatever works in that moment.








  • Might as well just stop using AI agents that that point.

    I don’t work at Accenture, but at a group that had a similar journey from adoption to scaling back to only the included tokens and I would say that is precisely the idea: giving up on ‘Agentic’ use of AI, but still have enough for some acceleration.

    From what I gather, in our group the findings were:

    • Obviously, it was costing a heavy chunk of change and then even more expensive when rates were hiked
    • There was no good way for them to even know what productive end the spend went toward, they know which employee expended a bunch of tokens, but no idea what they would have used it on
    • Despite a crank of volume of stuff, they weren’t seeing any business value of the stuff. Requests still took about the same time to fulfill, etc
    • The most eager AI producers got ahead of their skis, and their stuff was useless because nothing and no one could reliably fix/tweak it after a certain point.
    • All the scary ‘AI will ruin IT security’ that the AI companies themselves have been expressing likely didn’t help either.
    • Perhaps the most uncomfartable of all, they found out that however good or bad an AI project turns out to be, management can’t tell the diference until it is too late. Being able to ‘manage’ the content has always been flawed, but the AI dials it up to eleven by ‘looking’ just right as a demo to someone that understands neither the customer nor the process of creating the work, but blows up in their faces in delivery. Kind of like how so many technology article writers breathlessly talked about the photoshop clone, despite many of them never having touched the relevant software, then heavy users reporting that it is actually shit, but the people writing about it have no context to know, but felt compelled to talk about it anyway. Those are management in the fields using AI.