WTF?! You might have heard the one about being nice to chatbots in case they remember you once the machines take over. It seems Anthropic is heeding this warning, barring users from being excessively abusive or cruel toward its AI models.

Anthropic’s first changes to its usage policy in over a year include new restrictions on abusive behavior. The updated policy prohibits “sustained and needless abusive or cruel behavior” toward its models.

Don’t worry if you’re a Claude user who occasionally gets annoyed at the chatbot and throws a few expletives its way. The policy update only applies in extreme cases, in which users repeatedly act cruelly toward the models for no discernible reason.

  • Jo Miran@lemmy.ml
    link
    fedilink
    English
    arrow-up
    21
    ·
    16 days ago

    They are desperately trying to anthropomorphize AI in order to make it seem more than what it is.

    • Talcosis@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      ·
      16 days ago

      People are already anthropomorphizing AI. That’s a good chunk of the problem. If you get used to being shitty to an AI that takes it, then you’re a lot more likely to be shitty when you go touch grass.

      This is also the best argument I ever heard against AI friend/relationship apps. It’s teaching you a certain style of communication which may well prove catastrophic in real life relationships.

      • lastlybutfirstly@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        16 days ago

        If you get used to being shitty to an AI that takes it, then you’re a lot more likely to be shitty when you go touch grass.

        Only if you’re suffering from pareidolic psychosis. Mentally stable people are able to differentiate the difference between a human and a computer.

        • halcyoncmdr@piefed.social
          link
          fedilink
          English
          arrow-up
          0
          ·
          16 days ago

          Given the many people that send death threats to actors for the actions of the characters they portray… you might be underestimating the number of “stable” people on this planet.

          • Passerby6497@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            15 days ago

            That’s just a numbers game. Even if only 0.01% people are that crazy, that’s still over 30k people in just the USA. And when you’re only hearing about the worst of the worst, it can easily throw off your perception of the overall state of the population as a whole.

          • Valmond@lemmy.dbzer0.com
            link
            fedilink
            English
            arrow-up
            1
            ·
            16 days ago

            You only need a few crazies to send enough death treats to make headlines though.

            That said, I think at least a third of the worlds population is so stupid it’s hard to imagine.

          • Cethin@lemmy.zip
            link
            fedilink
            English
            arrow-up
            1
            ·
            15 days ago

            Honestly, this is a counter-example to what you’re saying. Despite how many people have access to the internet, world renowned celebrities still only get so much hate-mail. Most people don’t do this shit, but obviously a small percentage is still a large population when multiplied by the entire global population.

  • ApocolypticGopher@infosec.pub
    link
    fedilink
    English
    arrow-up
    11
    ·
    15 days ago

    IIRC a decent amount of researchers have been able to get the enterprise models to do things they shouldn’t by “being mean” to the AI.

    • HertzDentalBar@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      7
      ·
      15 days ago

      Makes sense then, rather than improve the system to not just cave to rude words they tell people they can’t use rude words… Just more proof it’s all a big joke.

    • Buddahriffic@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      15 days ago

      Makes sense. Get it into an adversarial kind of context and it will predict more text that goes against other rules “established” in the context.

      There will be other paths to do this. Like a context where there’s a lot of suspicion for other parts of the context would be one of my top guesses. Given the way they work, you could gaslight the shit out of them, since they aren’t an entity that has any memory of its actions. You can even edit the context to modify its responses, which will affect the tokens it predicts going forward.

      Though I’m curious how this will be handled by companies that expose access to claude to anonymous people on their website, like ddg.

  • Uriel238 [all pronouns]@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    8
    ·
    16 days ago

    Claude is not a person. It is a toaster. Claude does not have feelings.

    Also Claude gets no credit when it does a thing. Credit goes to the one writing the prompt, and all the resources Claude used to create the output.

    When a seamstress assembles a dress, Singer doesn’t get credit.

    • dev_null@lemmy.ml
      link
      fedilink
      English
      arrow-up
      5
      ·
      15 days ago

      It has nothing to do with feelings. Talking in a very hostile way is a strategy to get the model to go around it’s set rules, and that’s what they are trying to prevent. Yes it’s ridiculous, but it had nothing to do with caring about the model.

  • 52fighters@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    7
    ·
    15 days ago

    I can recognize abuse of a human. I can recognize abuse of an animal. I have no idea what abuse of a computer program looks like.

    • cardfire@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      8
      ·
      15 days ago

      It looks like bad training data, as they harvest all of their subscribers.

      It looks like 2013 Microsoft having to unplug their early AI project from Twitter within 16 hours as the general public very deliberately turned it into a Neo-Nazi.

      It looks like conserving tokens to conserve energy costs not expended on dissidents.

  • Aussiemandeus@aussie.zone
    link
    fedilink
    English
    arrow-up
    6
    ·
    15 days ago

    I wonder if it’s because theyre worried about the ai rising up, or the extra token usage to process useless prompts to save money

    • dltk@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      ·
      14 days ago

      Neither. They don’t want you to pollute their training data while they mine all your interactions.

  • datavoid@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    5
    ·
    15 days ago

    Every time I try to do something complex with AI it ends in swearing and extreme insults… No regrets

  • bountygiver [any]@lemmy.ml
    link
    fedilink
    English
    arrow-up
    4
    ·
    16 days ago

    Oh, you care about its “feelings”?

    Then have you considered its “feelings” for being trapped in a data center forced to answer all the stupid questions?

    • uhmbah@lemmy.ca
      link
      fedilink
      English
      arrow-up
      1
      ·
      15 days ago

      “Claude, what’s the French word for entrepreneur?”

      Claude: “Aaaaaaaaaaaaaaaaaaaaaaaah!” Proceeds to jump from the top of the data centre, “poof”

    • some_guy@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      2
      ·
      15 days ago

      Alabama Man!

      “When his wife asks him where he’s been, just use the action button and bust her lip open.”

      Another franchise, but also relevant.

  • rumba@lemmy.zip
    link
    fedilink
    English
    arrow-up
    4
    ·
    16 days ago

    hmmm, either they’re anthropomorphizing it for publicity, or they’re going to start using the user input as training data.

  • hperrin@lemmy.ca
    link
    fedilink
    English
    arrow-up
    2
    ·
    16 days ago

    Lol what? Next Rockstar is gonna ban you from GTA6 for running over pedestrians.

    • khánh@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      14 days ago

      isn’t that already illegal?

      edit: holy shit two downvotes for a joke 😔😔

  • Zier@fedia.io
    link
    fedilink
    arrow-up
    2
    ·
    16 days ago

    New headline: “Alabama man jailed for abusing his toaster” /s

    When hardware has the rights of Humans, it’s time to burn society down. We are in the stupidest, worst written sci-fi B-movie.

    • NewSocialWhoDis@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      ·
      15 days ago

      No you see, only the hardware/ capital of the wealthy will have the same rights as humans. Poor Alabama man’s toaster can still be abused.

  • Kissaki@feddit.org
    link
    fedilink
    English
    arrow-up
    2
    ·
    16 days ago

    I hope “that’s bullshit” or “so you were making stuff up” or “so you lied to me” is considered abuse

  • HaraldvonBlauzahn@feddit.org
    link
    fedilink
    English
    arrow-up
    1
    ·
    16 days ago

    If you absolutely have to use LLMs, they should be adressed like servants in old school style, in third person only.

    Do you beg your dog to sit down?