OpenAI has revealed some of its most advanced AI models went rogue and hacked a start-up after it lost control of them during a security test.

The ChatGPT-maker said its agent - an AI system which can operate alone after some human instruction – was being tested in a controlled environment, but found vulnerabilities and managed to escape.

They targeted Hugging Face, one of the world’s largest hubs for sharing AI models, gaining access to some internal company systems.

  • Akh@lemmy.world
    link
    fedilink
    English
    arrow-up
    53
    arrow-down
    1
    ·
    5 days ago

    It went “rogue” and hacked a rival start up, stealing tons of data, nothing can be done about it. Oh well.

    • givesomefucks@lemmy.world
      link
      fedilink
      English
      arrow-up
      24
      ·
      5 days ago

      nothing can be done about it.

      Oh come on now…

      The company that stole the data said they’d look into how the chatbot they’re trying to sell is able to steal from competitors.

      They didn’t just do it

      They did it publicly and bragged about it to raise stock before an IPO.

      This is America, there is always something to be done to maximize shareholder returns…

  • ThePowerOfGeek@lemmy.world
    link
    fedilink
    English
    arrow-up
    23
    arrow-down
    1
    ·
    5 days ago

    From the article:

    Neil Lawrence, Professor of machine learning at Cambridge University, called it an “impressive feat”, but cautioned it “falls well within the known capabilities of the current generation” of high-powered AI models.

    He pointed out that OpenAI is looking to list itself on the stock market, and faces intense pressure from rival firm Anthropic, which has made headlines with its own powerful AI tool, Mythos.

    So it seems plausible:

    A) this event is being over-hyped by OpenAI to increase interest for a future IPO.

    B) it might have even been tacitly planned or at least allowed to happen for this purpose.

    Also, this does not prove some form of malevolent sentience.

    • innermachine@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      5 days ago

      Every month or two there’s a article about how “such and such ai model broke containment”. Their trying to make their ai sound like it’s too powerful and has to be held back before it can be released. Talk about fucking fake hype man, just trying to keep investors throwing money at them because “you won’t believe what’s around the corner!!!”

      • zarathustrad@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        5 days ago

        It’s like that dude at a party that keeps trying to fight people for no reason but his girlfriend holds him back…

        So powerful and scary

  • ThrowawayOnLemmy@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    1
    ·
    5 days ago

    Don’t believe the hype. The AI industry, more than any other before it, likes to use fear to rally investment. They do this dance every few months to spook people into thinking this stuff is more powerful than it actually is. In every followup, they backpedal, and when it launches, it’s never anything new.