User-agent: * Disallow: /spartronics-slack/ Disallow: /chronology/ # See https://seirdy.one/robots.txt ## Ad Scrapers User-agent: Adsbot User-agent: BLEXBot User-agent: peer39_crawler User-agent: peer39_crawler/1.0 Disallow: / ## IP (not that IP) Scrapers User-agent: BrandVerity/1.0 User-agent: CheckMarkNetwork/1.0 User-agent: CheckMarkNetwork/1.0 (+https://www.checkmarknetwork.com/spider.html) User-agent: NPBot User-agent: PiplBot User-agent: SlySearch User-agent: TurnitinBot User-Agent: AcademicBotRTU User-agent: PiplBot Disallow: / ## LLM Scrapers User-agent: ChatGPT-User User-agent: GPTBot User-agent: ClaudeBot User-agent: Applebot-Extended User-agent: Google-Extended User-agent: FacebookBot User-agent: meta-externalagent User-Agent: GenAI User-Agent: SemrushBot-OCOB User-Agent: SemrushBot-FT User-agent: Cotoyogi User-agent: Webzio-extended User-agent: Kangaroo Bot User-Agent: VelenPublicWebCrawler Disallow: /