About our crawler

When someone asks us to grade a website, we make a handful of requests to it with the user agent AIVisibilityGrader/1.0 (+https://ai-visibility-grader.vercel.app/about-bot). We fetch only the homepage, /robots.txt, the sitemap and /llms.txt; if the homepage turns that user agent away, we try it once more as an ordinary browser so we can report what happened. We do not follow links or crawl any further.