20250602 - Fighting the AI scraper bots

We are lucky they are so very stupid.

Text version: https://pivot-to-ai.com/2025/06/02/fighting-the-ai-scraper-bots-at-pivot-to-ai-and-rationalwiki/

Patreon: https://www.patreon.com/davidgerard

Ko-Fi: https://ko-fi.com/A1529D5

Buy me nice things: https://www.amazon.co.uk/hz/wishlist/ls/3Q8VZW46J6DM6

Get an extremely cool Pivot to AI shirt or mug: https://pivot-to-ai.redbubble.com

Sources:

1 Million Third-Party Android Devices Have a Secret Backdoor for Scammers https://www.wired.com/story/1-million-third-party-android-devices-badbox-2/

jwz's Blog: https://www.jwz.org/blog/

Previously on Pivot to AI:

What the floods of AI scraper bots look like in 2025 https://pivot-to-ai.com/2025/03/02/what-the-floods-of-ai-scraper-bots-look-like-in-2025/

That RationalWiki configuration fragment:

        set $BOT "";
        if ($uri ~* (/w/index.php)) {
            set $BOT "C"; }

Full Pivot to AI playlist: https://www.youtube.com/playlist?list=UU9rJrMVgcXTfa8xuMnbhAEA