# https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/ User-agent: facebookexternalhit User-agent: meta-externalagent # https://imagesift.com/about User-agent: ImagesiftBot # https://platform.openai.com/docs/bots User-agent: GPTBot # https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers User-agent: GoogleOther # https://www.mj12bot.com/ User-agent: MJ12bot # https://support.anthropic.com/en/articles/10023637-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler User-agent: ClaudeBot # https://developer.amazon.com/support/amazonbot User-agent: Amazonbot Disallow: /npub Disallow: /nprofile Disallow: /note Disallow: /nevent Disallow: /naddr User-agent: * Crawl-delay: 60