WebMCPDiscoveryBot

This bot performs a one-time measurement of public WebMCP adoption on Shopify storefronts. It reads robots.txt, then permitted homepage HTML and, only when necessary, same-origin JavaScript bundles. Raw page content is not retained.

Identity

WebMCPDiscoveryBot/1.0. Requests are cryptographically signed using Web Bot Auth. Public keys are available at /.well-known/http-message-signatures-directory.

Rate and directives

The crawler honors Disallow, Crawl-delay, and Request-rate. It self-reduces its per-address rate on HTTP 429/503 and honors Retry-After.

Opt out

Website operators can opt out with robots.txt:

User-agent: WebMCPDiscoveryBot
Disallow: /

Contact

ilay@nekuda.ai