User-Agent: *
Allow: /
Disallow: /app
Disallow: /auth
Disallow: /api
Disallow: /login
Disallow: /try/continue
Disallow: /go/continue
Disallow: /pricing/
Disallow: /fr/pricing/
Disallow: /es/pricing/
Disallow: /lab/
Disallow: /mcp
Disallow: /oauth/

Sitemap: https://cratewire.com/sitemap.xml