# https://fishare.app/robots.txt # Public content is open to all crawlers. App-internal previews, the API, # and admin are kept out of every index. User-agent: * Allow: / Disallow: /preview/ Disallow: /api/ Disallow: /admin # ── AI search & assistant crawlers ────────────────────────────────── # Explicitly welcomed. Fishare WANTS to be cited in ChatGPT Search, # Perplexity, Claude, Microsoft Copilot and Google's AI features. Per # OpenAI's crawler docs, a site that disallows OAI-SearchBot is excluded # from ChatGPT search answers, so these are allow-listed on purpose. # (A named user-agent group does not inherit the "*" group, so the same # Disallow set is repeated here.) User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: ClaudeBot User-agent: Claude-User User-agent: Anthropic-AI User-agent: Google-Extended User-agent: Bingbot User-agent: Applebot-Extended Allow: / Disallow: /preview/ Disallow: /api/ Disallow: /admin Sitemap: https://fishare.app/sitemap.xml