User-agent: * Disallow: /spartronics-slack/ Disallow: /chronology/ # See https://seirdy.one/robots.txt ## Ad Scrapers User-agent: Adsbot User-agent: BLEXBot User-agent: peer39_crawler User-agent: peer39_crawler/1.0 Disallow: / ## IP (not that IP) Scrapers User-agent: BrandVerity/1.0 User-agent: CheckMarkNetwork/1.0 User-agent: CheckMarkNetwork/1.0 (+https://www.checkmarknetwork.com/spider.html) User-agent: NPBot User-agent: PiplBot User-agent: SlySearch User-agent: TurnitinBot Disallow: / ## LLM Scrapers User-agent: ChatGPT-User User-agent: GPTBot User-agent: ClaudeBot Disallow: / ## (More) LLM Scrapers User-agent: Applebot-Extended User-agent: Google-Extended User-agent: FacebookBot User-agent: meta-externalagent Disallow: /