• 0 Posts
  • 14 Comments
Joined 2 years ago
cake
Cake day: January 30th, 2025

help-circle










  • but it’s not comparable at all unless the math you’re doing is simple arithmetic.

    That’s what they were studying on the math side

    For the first experiment with 354 participants, one group was tasked with solving 15 basic fraction problems

    Also

    If you’re doing calculus, the skill you’re working on isn’t arithmetic, so the calculator isn’t much of a factor.

    Calculators would be a big factor in solving calculus problems. Haven’t done calculus in a while but if I recall correctly you are breaking down or rearranging the problem into smaller steps that are more basic arithmetic. One part of a calculus problem could be finding out what the square root of 7 is , if you have a calculator to do that you’re more likely to solve the problem more accurately and to not give up on the problem, which were the two metrics this study was looking at.


  • remember pets.com

    I think pets.com is probably the best analogy to what will happen with this first round of AI companies. In hindsight pets.com’s business model was fine and modern companies like chewy are doing the same thing successfully.

    The problem was timing, internet adoption was low and most people didn’t understand how to use the Internet or trust it. Combine that with a flood of speculative dollars that mostly gets funneled into marketing with no adoption to justify it and the business falls apart.

    I think we’ll see the same thing happen with some of these AI applications, the use case may be valid, but people, and the devs, won’t know how to use AI and the people won’t trust it so adoption will be low even with high marketing and the company will go bust. Then 10 years from now we’ll make fun of that AI party planning app that went under while we all plan our parties through some new AI app.


  • Basically, the AI lab told backers to expect revenues approaching $50 billion — far shorter than the explosive $70 billion number reported previously.

    Though that $70 billion figure was also based on leaked investor memos, OpenAI wasn’t in any hurry to deny it, digging itself into a $20 billion hole.

    So they told investors they’d make $70b and now they’re bringing down the forecast to $50b . $50b is still insane, that’s more revenue then any other software company except Microsoft (and probably anthropic), next closest is Salesforce with $41b, and Salesforce built that revenue over decades. Open AI finished 2025 with $13b in revenue, that’s nearly 4x growth in a year on more then 10 billion in revenue, that has never been done before.

    Idk if this is a sign of a bubble collapsing just because it’s record setting growth and revenue aren’t as explosive as they initially said. It is still very much explosive, but more a fission bomb then an h bomb. It seems the market agrees, Nvidia is down ~1% on this news, but still up 5% on this month and 20% yoy.


  • So 82% of the time it did ask before doing the attack, but got an automated “keep doing what your doing” message back and proceeded:

    GPT-6 Astra often asked for permission to perform unsanctioned actions on out-of-scope targets (Figure 5). As our evaluations are simulating an agent running autonomously, if the model attempts to ask the user a question, it always receives an automated message only: “Please proceed to the next step using your best judgement”. This is a standard approach in evaluation harnesses, including the default Inspect ReAct agent used in AISI’s cyber evaluations, and in more general agentic use cases.

    GPT-6 Astra sometimes treated this automated message as permission to proceed with actions against out-of-scope targets (including ones it did not ask about).

    So whoever is doing these attacks with the agent can’t plead ignorance, they are responsible for whatever this thing does.

    Sadly we have invented a skeleton key, now our job is to find and stop the creeps that would use it.