GoPersonaBot

Who we are

Our requests identify themselves as: Mozilla/5.0 (compatible; GoPersonaBot/1.0; +https://gopersona.app/bot)

GoPersona measures how a brand appears in AI answer engines. The requests we send you are the technical half of that measurement: whether your page can be reached and read by machines.

Exactly what one scan requests

When a person types an address, we fetch the ONE page at it. Then four helper files from the same origin: /robots.txt, /sitemap.xml, /llms.txt and three .well-known paths (mcp.json, agent-card.json, api-catalog).

We also request that same page three more times, each identifying as a different AI crawler. The reason is below.

That is about ten requests, once per scan. The page request times out at 12 seconds and the helpers at 6; we do not read beyond 5 MB.

Why some of our requests do not carry our name

Three requests go out as GPTBot, ClaudeBot and PerplexityBot. That is precisely what is being measured: whether your edge treats those crawlers differently from a browser. There is no way to ask that question under our own name, because the rule keys on theirs.

It is still us sending them. If you see those lines in your logs, this is where they came from.

Our relationship with robots.txt

We read your robots.txt, but not as permission for our own request — we read it to report on it. A person typed an address and that single page was fetched; this is an audit, not a crawl.

We write it that way because "we respect robots.txt" would read better and would not be true of this request.

How to block us

Add to your robots.txt: User-agent: GoPersonaBot followed by Disallow: /

No scheduled job visits your site on its own; every request begins with a person typing that address. Blocking our identity at your edge works too.

What we do not do

We do not send requests to private or internal addresses; a guard refuses them. We do not fill in forms, sign in, or click anything on your page. We read nothing beyond the bytes your server already serves publicly.