• Infamousblt [any]@hexbear.netM
    link
    fedilink
    English
    arrow-up
    81
    ·
    4 months ago

    Critical support to SCP and other fanfic sites for ruining LLM output. Now I think we should all be writing as much ridiculous fanfiction as possible in hopes that other AI uses it as inputs and further ruins itself

    • Beaver [he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      42
      ·
      4 months ago

      I was annoyed at the flood of SCP entries diluting the less refined but more honest creepy fiction of the initial run. But now I see that it was actually praxis.

    • BodyBySisyphus [he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      74
      ·
      4 months ago

      Geoff Lewis is venture capitalist who runs a multi billion dollar company that has invested a lot into OpenAI. He has apparently gone off the rails and is posting conspiracy theory gibberish on twitter. He appears to be convinced he’s being manipulated by a “non-governmental system” that he’s on the verge of rooting out, and the gibberish happens to have a similar format to the distinctive house style of the SCP wiki, a collaborative fiction project about an organization that tracks and contains paranormal objects and entities.

        • CloutAtlas [he/him]@hexbear.net
          link
          fedilink
          English
          arrow-up
          43
          ·
          4 months ago

          The LLM got poisoned by some wiki that details fictional paranormal beings. The “AI” can’t tell that this modern collaborative Voynich Manuscript is a work of fiction. Billionaire essentially falls victim to what amounts to cryptid fan fiction.

        • LangleyDominos [none/use name]@hexbear.net
          link
          fedilink
          English
          arrow-up
          40
          ·
          4 months ago

          He asked ChatGPT questions in a way that made it think he’s talking about SCP stories. ChatGPT responded with a generated SCP story. But the CEO guy thinks it’s real. He thinks that ChatGPT found a shadow organization that erases itself from news, the media, the internet, etc and hunts down people who try to treat LLMs as real AGI. He’s basically convinced himself he’s being gangstalked.

        • Belly_Beanis [he/him]@hexbear.net
          link
          fedilink
          English
          arrow-up
          26
          ·
          4 months ago

          Special Containment Procedures/Secure, Contain, Protect/SCP is really cool if you haven’t read them before. There’s thousands, but you only need to read a few of the well-known ones to understand the story. In addition to what other posters have said, it’s a website where everything is in-character. It’s presented as a secret database for a shadowy organization investigating cryptids and the paranormal.

          The short story contests are much easier to digest, since some of the entries can get incredibly meta. What’s especially cool is how it’s entirely public domain. There are some specifics about how entries are used by third parties, but it’s pretty open. There have been short films, video games, and fan art for all of it.

          It spawned from a post on 4chan’s /x/ board years ago and has since been taken away from chuds to be a leftwing space. The original post:

        • CloutAtlas [he/him]@hexbear.net
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 months ago

          Are you familiar with the Voynich Manuscript? A 600 year old codex that illustrates and catalogues a whole bunch of plants that do not exist and have not been illustrated/described in any other document. A leading theory is that the book was meant to be a work of fiction about plants in a different world.

          Anyway, imagine a collaborative 21st century fiction on a wiki that’s basically that. Thousands of people working on a shared universe where cryptids and paranormal beings exist, and are being contained by a foundation, and no-one breaks the 4th wall to let the reader know this is an elaborate network of fiction. Now, imagine if predictive text machine that burns forests gets a hold of this website. Now imagine if a billionaire is crashing out on Twitter because GPT started talking in the style of the fictional cryptid wiki.

  • dkr567 [comrade/them, he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    57
    ·
    edit-2
    4 months ago

    All these “cognitohazards” reminds me of those chain letter spams you’d receive in your email ages ago but instead of going “who cares?” or “don’t worry about it” and deleting the message, the LLM and techbros took it all seriously.

    • 30_to_50_Feral_PAWGs [she/her]@hexbear.net
      link
      fedilink
      English
      arrow-up
      11
      ·
      4 months ago

      Tripping balls on peyote while playing the NES version of Rampage and coming out of it earnestly believing that it all really happened to you, and that you were, in fact, the ape. all-my-apes-gone

  • krolden@lemmy.ml
    link
    fedilink
    English
    arrow-up
    32
    ·
    4 months ago

    Lmao this is too good to be true.

    Also that Geoff guy is a gigantic piece of shit wow

  • batsforpeace [any, any]@hexbear.net
    link
    fedilink
    English
    arrow-up
    20
    ·
    4 months ago

    ties together a few things like techbro people falling for dumb shit and marketing themselves as knowledgeable, like the whole ‘we need to align AI to be good because super intelligence is around the corner’ group, right wingers falling for fantastic explanations ‘because it sounds cool so it must be true’ but also conveniently avoids reality and the economic system, chatbots throwing together whatever text is statistically relevant to the query not being able to tell fact from fiction, corps manually curating a large dataset being unprofitable so the problem will never be fixed, cheaper to just add a hardcoded answer after funny AI answer posts go viral, also corps lobbying chatbots into schools to cut on labour while knowing it serves up bunk

  • ANarcoSnowPlow [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    2
    ·
    4 months ago

    This is hilarious. Try to do this kind of thing with deep seek and it says something like “it looks like you’re roleplaying a sci-fi game. I’d be happy to play along, but this is not real, it’s important to understand that.”