Pro@programming.dev to Technology@lemmy.worldEnglish · 1 month agoAnubis, The Opensource Defender Against AI Bots: I fight bots in my free timexeiaso.netexternal-linkmessage-square18linkfedilinkarrow-up1366arrow-down14file-text
arrow-up1362arrow-down1external-linkAnubis, The Opensource Defender Against AI Bots: I fight bots in my free timexeiaso.netPro@programming.dev to Technology@lemmy.worldEnglish · 1 month agomessage-square18linkfedilinkfile-text
minus-squarelagoon8622@sh.itjust.workslinkfedilinkEnglisharrow-up4·1 month agoIt does, yes. This will prevent your content from being indexed, in most cases. The benefit is that your servers will be up. If your servers are down, they can’t be indexed either
It does, yes. This will prevent your content from being indexed, in most cases. The benefit is that your servers will be up. If your servers are down, they can’t be indexed either