AuditBot

Crawler policy

AuditBot is the crawler FlareMark's platform runs on the sites FlareMark manages or the sites of engagements it is working on. It does not crawl the open web.

Last updated October 19, 2026.

Why it visited your site

Because FlareMark manages that site, or because the site belongs to a client of an active engagement. If neither applies to you, it shouldn't have visited — tell us.

How it behaves on the sites it crawls

  • Honors robots.txt directives, including User-agent: AuditBot rules
  • Reads robots.txt at the start of each host's crawl; a change takes effect on the next crawl
  • One request per second, and never more than one concurrent request per host
  • Does not read Crawl-delay; the fixed one-second spacing is the crawler's pace
  • Identifies itself in the User-Agent on every request — it never masks as a browser
  • Does not retry a failed or blocked request. It records the response and moves on; a block page or CAPTCHA is recorded as the server returned it, never solved or routed around
  • Reads only publicly accessible pages; never forms, login areas, or private data
  • Does not execute JavaScript. It reads the HTML the server sends, so client-rendered content is invisible to it
  • Stores page text and structure — not your visitors. Nothing it reads is published anywhere except inside the report for the client who owns the site, and it is never used to train models

Identifying it

Every request carries this exact User-Agent string:

AuditBot/1.0 (+https://auditbot.flaremark.com/bot/)

Controlling it

To limit or block AuditBot on a site you manage, add a robots.txt directive:

User-agent: AuditBot
Disallow: /private-path/

Full exclusion works the same way with Disallow: /. If you would rather it did not visit at all while an engagement is paused, that is also Disallow: / — no other step is needed, and we will not route around it. A Crawl-delay longer than one second is not applied; blocking the path is the reliable control.

Terms and privacy

Crawl activity on FlareMark-managed sites is governed by the platform's terms and privacy policy.

Contact

Questions or crawl problems: contact@flaremark.com. A human reads this, and you'll hear back from Harvey directly, usually within one business day. If AuditBot is causing load problems, put that in the subject line and it will be stopped the same day.