Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
1 Aug 2026 15:42:49
Crawling time:00:01:15
Pages/Seconds2.7
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://developers.notion.com/guides/data-apis/importing-external-file ...
Title: Importing external files - Notion Docs Description: Learn how to migrate files from an exter ... H1: Importing external files |
Description too short
|
| 0 | 200 |
https://developers.notion.com/reference/webhooks/database-created
Title: Database created - Notion Docs Description: Webhook event for database created in a ... H1: Database created |
Description too short
|
| 0 | 200 |
https://developers.notion.com/guides/mcp/hosting-open-source-mcp
Title: Hosting a local MCP server - Notion Docs ... Description: Learn how and when to use the open-sourc ... H1: Hosting a local MCP server |
Description too short
|
| 0 | 200 |
https://developers.notion.com/reference/webhooks/file-upload-expired
Title: File upload expired - Notion Docs Description: Webhook event for file upload expired in ... H1: File upload expired |
Description too short
|
| 0 | 200 |
https://developers.notion.com/reference/webhooks/file-upload-created
Title: File upload created - Notion Docs Description: Webhook event for file upload created in ... H1: File upload created |
Description too short
|
| 0 | 200 |
https://developers.notion.com/reference/webhooks/file-upload-completed ...
Title: File upload completed - Notion Docs Description: Webhook event for file upload completed ... H1: File upload completed |
Description too short
|
| 0 | 200 |
https://developers.notion.com/reference/admin/revoke-user-session
Title: Revoke a managed user''s sessions - Noti ... Description: Revoke a managed user's sessions. H1: Revoke a managed user''s sessions |
Description too short
|
| 0 | 307 |
https://developers.notion.com/guides/resources/examples
|
Non-301 Redirects
Redirect
|
| 0 | 200 |
https://developers.notion.com/reference/webhooks/database-content-upda ...
Title: Database content updated - Notion Docs Description: Webhook event for database content updat ... H1: Database content updated |
Description too short
|
| 0 | 200 |
https://developers.notion.com/reference/webhooks/database-schema-updat ...
Title: Database schema updated - Notion Docs Description: Webhook event for database schema update ... H1: Database schema updated |
Description too short
|