🤖

    WebsiteCoachBot

    The official web crawler operated by WebsiteCoach.com. It audits websites for performance, security, SEO, and accessibility issues — on demand, at the explicit request of the site owner or an authorised user.

    User-Agent String

    WebsiteCoachBot identifies itself with the following User-Agent header on every request:

    Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/146.0.0.0 Safari/537.36 (compatible; WebsiteCoachBot/1.0; +https://websitecoach.com/bot)

    The token above uniquely identifies all requests from this crawler. compatible; WebsiteCoachBot/1.0; +https://websitecoach.com/bot

    Key Facts

    Operator
    WebsiteCoach.com
    Crawl Type
    On-demand only
    Infrastructure
    Cloudflare Workers + browser rendering
    Crawl Depth
    Homepage only
    Max Requests/Audit
    Homepage GET, rendered audit, and up to 40 link checks
    Data Stored
    Audit report data and fresh-scan HTML evidence

    What Does It Do?

    WebsiteCoachBot performs a one-time, on-demand audit of a website when a user submits a URL on WebsiteCoach.com or through the WebsiteCoach API. It does not crawl the web autonomously.

    During a single audit, it may make the following types of requests:

    • Fetch and, when needed, browser-render the homepage HTML
    • Check (robots.txt, llms.txt / AGENTS.md)
    • Check internal links found on the homepage (up to 40 lightweight requests)
    • Measure response time, redirects, headers, schema, page quality, and crawlability signals

    Most requests complete within about 60 seconds. The bot checks and respects robots.txt before auditing, and can use user-provided domain headers when a site owner configures them in WebsiteCoach.

    How to Allow WebsiteCoachBot

    ✅ Default behaviour

    WebsiteCoachBot respects your robots.txt. If your site has no restrictions, no action is required.

    Explicitly allow in robots.txt

    User-agent: WebsiteCoachBot
    Allow: /

    Allow through a WAF or firewall

    If your WAF blocks unknown bots, add a rule to allow requests containing:

    WebsiteCoachBot/1.0

    The bot runs on Cloudflare's network, so originating IPs cannot be used reliably for allowlisting.

    How to Block WebsiteCoachBot

    ⚠️ Block in robots.txt

    User-agent: WebsiteCoachBot
    Disallow: /

    The bot checks and honours robots.txt before making any requests.

    Block via User-Agent string

    Configure your web server or CDN to return a 403 Forbidden response to any request containing WebsiteCoachBot in the User-Agent header.

    Privacy & Data

    WebsiteCoach stores generated audit results and, for fresh scans, may store the fetched or browser-rendered HTML snapshot shown in the report so users can verify what WebsiteCoach received. Cached report data may be retained for up to 30 days unless saved in an account or required for billing, security, abuse prevention, or legal reasons. WebsiteCoachBot does not intentionally extract personal information from page content.

    For questions about data handling, see our Privacy Policy.

    Contact

    If you have questions about WebsiteCoachBot or want to report an issue: