Declare your AIndependence: block AI bots, scrapers and crawlers with a single click
This is a great move from Cloudflare. I may start using their service.
Link tags: crawlers
8
Should I remove this blog from Google Search?・The Jolly Teapot
There was life before Google search. There will be life after Google search.
Google is not a huge source of traffic and visibility. I get most of my visits from RSS readers, other people’s links including fellow bloggers, or websites like Hacker News. It’s hard to tell at this point since I don’t track anything, but that’s an educated guess.
Removing my website from Google would have very little impact, so I was wondering if I should just do it.
AI Pollution – David Bushell – Freelance Web Design (UK)
AI is steeped in marketing drivel, built upon theft, and intent on replacing our creative output with a depressingly shallow imitation.
Neatnik Notes · Gotta block ’em all
While we’re playing whack-a-mole, let’s poison these rodents.
Blocking bots – Manu
Blocking the bots is step one.
Perplexity AI Is Lying about Their User Agent • Robb Knight
See, this is exactly why we need to poison these bots.
AI Agents robots.txt Builder | Dark Visitors
A handy resource for keeping your blocklist up to date in your robots.txt file.
Though the name of the website is unfortunate with its racism-via-laziness nomenclature.
Robots.txt - Jim Nielsen’s Blog
I realized why I hadn’t yet added any rules to my
robots.txt: I have zero faith in it.