misk@sopuli.xyz to Technology@lemmy.worldEnglish · 1 year agoAsking ChatGPT to Repeat Words ‘Forever’ Is Now a Terms of Service Violationwww.404media.coexternal-linkmessage-square231fedilinkarrow-up1897arrow-down118
arrow-up1879arrow-down1external-linkAsking ChatGPT to Repeat Words ‘Forever’ Is Now a Terms of Service Violationwww.404media.comisk@sopuli.xyz to Technology@lemmy.worldEnglish · 1 year agomessage-square231fedilink
minus-squareBuddahriffic@lemmy.worldlinkfedilinkEnglisharrow-up8·1 year agoI don’t think that would trigger it. There’s too much context remaining when repeating something like that. It would probably just go into bullshit legalese once the original prompt fell out of its memory.
minus-squarehex_m_hell@slrpnk.netlinkfedilinkEnglisharrow-up8·1 year agoIt looks like there are some safeguards now against it. https://chat.openai.com/share/1dff299b-4c62-4eae-88b2-0d209e66b479 It also won’t count to a billion or calculate pi.
minus-squaredrislands@lemmy.worldlinkfedilinkEnglisharrow-up4·1 year ago calculate pi Isn’t that beyond a LLM’s capabilities anyway? It doesn’t calculate anything, it just spits out the next most likely word in a sequence
minus-squarehex_m_hell@slrpnk.netlinkfedilinkEnglisharrow-up4·1 year agoRight, but it could dump out a large sequence if it’s seen it enough times in the past.
I don’t think that would trigger it. There’s too much context remaining when repeating something like that. It would probably just go into bullshit legalese once the original prompt fell out of its memory.
It looks like there are some safeguards now against it. https://chat.openai.com/share/1dff299b-4c62-4eae-88b2-0d209e66b479
It also won’t count to a billion or calculate pi.
Isn’t that beyond a LLM’s capabilities anyway? It doesn’t calculate anything, it just spits out the next most likely word in a sequence
Right, but it could dump out a large sequence if it’s seen it enough times in the past.