Crawler
ScorraBot
ScorraBot fetches web pages for Scorra, a tool that shows brands how AI assistants describe them and which pages those assistants quote. If you found this address in your server logs, this page says what the requests are and how to control them.
How it identifies itself
Requests carry this User-Agent header:
ScorraBot/1.0 (+https://getscorra.com/bot; brand visibility research)
The token for robots.txt is ScorraBot. Until September 2026 the crawler was called ClarityAIBot; rules written for that name are still honoured.
What it fetches
- A site's own pages, when its owner asks for it. A Scorra customer can crawl and audit their own website: robots.txt, sitemaps and the pages listed there.
- Single pages that AI assistants cite. When a customer analyses a page an assistant quoted in an answer, that one page is read to see what it says.
Some single-page reads go through third-party rendering services, which may identify themselves with their own User-Agent.
How to control it
Site crawls read robots.txt first and follow the group for ScorraBot, or the * group when there is none. To keep it out of your whole site:
User-agent: ScorraBot Disallow: /
To keep it out of one section only, disallow that path instead, for example:
User-agent: ScorraBot Disallow: /checkout/
Contact
Questions about the crawler or a request to stop it: support@getscorra.com