UngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 2 years agoSites scramble to block ChatGPT web crawler after instructions emergearstechnica.comexternal-linkmessage-square6fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkSites scramble to block ChatGPT web crawler after instructions emergearstechnica.comUngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 2 years agomessage-square6fedilink
minus-squarem-p{3}@lemmy.calinkfedilinkEnglisharrow-up0·2 years agoLemmy.ca added a block at the nginx level for it https://lemmy.ca/comment/1999439 # curl -H 'User-agent: GPTBot' https://lemmy.ca/ -i HTTP/2 403
minus-squareThe Bard in Green@lemmy.starlightkel.xyzlinkfedilinkEnglisharrow-up1·2 years agoHilariously, unless ALL lemmy instances do this, anyone that federates with you will have to block it too or any communities they sync with you will be available on their instances…
Lemmy.ca added a block at the nginx level for it
https://lemmy.ca/comment/1999439
# curl -H 'User-agent: GPTBot' https://lemmy.ca/ -i HTTP/2 403Hilariously, unless ALL lemmy instances do this, anyone that federates with you will have to block it too or any communities they sync with you will be available on their instances…