Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
21 Jul 2026 11:28:6
Crawling time:00:01:22
Pages/Seconds2.4
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://www.testmuai.com/support/docs/analytics-overview/
Title: TestMu AI - Test Insights for visualizin ... Description: Optimize test management with Test Insig ... H1: TestMu AI - Test Insights for visualizin ... |
Title too long
|
| 0 | 200 |
https://www.testmuai.com/support/docs/getting-started-with-agent-testi ...
Title: World''s First Agentic Testing Platform ... Description: Validate test chatbots, voice assistants ... H1: Getting Started With Agent Testing Platf ... |
Title too long
|
| 0 | 200 |
https://www.testmuai.com/support/docs/smart-visual-regression-testing/ ...
Title: Explore Visual Regression tests with Sma ... Description: Experience Visual Regression Testing at ... H1: Explore Visual Regression tests with Sma ... |
Title too long
|
| 0 | 200 |
https://www.testmuai.com/support/docs/kane-cli-introduction/
Title: Kane CLI Documentation - Getting Started ... Description: Kane CLI is an AI-powered command-line t ... H1: Kane CLI Documentation - Getting Started ... |
Title too long
|
| 0 | 200 |
https://www.testmuai.com/support/docs/app-testing-on-real-devices/
Title: Getting started with Real Device App Tes ... Description: Test mobile apps on 3000+ real devices w ... H1: Getting Started with Real Device App Tes ... |
Title too long
|
| 0 | 200 |
https://www.testmuai.com/login/?redirectTo=https://accounts.lambdatest ...
Title: [empty] Description: [empty] H1: [empty] |
H1 is missing
Canonical is missing
Title is missing
Description is missing
|
| 0 | 200 |
https://www.testmuai.com/support/docs/upload-files-using-testmu/
Title: Upload Files Using TestMu AI Selenium Gr ... Description: Upload files to the TestMu AI Selenium G ... H1: Upload Files Using TestMu AI Selenium Gr ... |
More than one H1 on page
Title too long
|
| 0 | 200 |
https://www.testmuai.com/support/docs/javascript-with-selenium-running ...
Title: Selenium With JavaScript | TestMu AI (Fo ... Description: Run JavaScript Selenium test scripts on ... H1: Selenium With JavaScript |
Long URLs
|
| 0 | 200 |
https://www.testmuai.com/support/docs/playwright-testing/
Title: How To Run Playwright Tests On TestMu AI ... Description: Here you can learn how to run Playwright ... H1: Getting Started With Playwright Testing |
Title too long
|
| 0 | 200 |
https://www.testmuai.com/support/docs/getting-started-with-cypress-tes ...
Title: Getting Started With Cypress Testing On ... Description: In this documentation, learn how to perf ... H1: Getting Started With Cypress Testing |
Title too long
|