Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
5 Sep 2026 18:10:35
Crawling time:00:00:24
Pages/Seconds2.5
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://www.rankmefirst.ai/blog/how-to-connect-rankmefirst-to-your-web ...
Title: How to Connect RankMeFirst to WordPress, ... Description: Follow detailed steps to connect RankMeF ... H1: How to Connect RankMeFirst to WordPress, ... |
Canonical ≠ URL
Title too long
H1 too long
|
| 0 | 200 |
https://www.rankmefirst.ai/blog/how-much-does-generative-engine-optimi ...
Title: How Much Does Generative Engine Optimisa ... Description: GEO pricing in Australia varies widely b ... H1: How Much Does Generative Engine Optimisa ... |
Canonical ≠ URL
Title too long
|
| 0 | 200 |
https://www.rankmefirst.ai/blog/how-nap-errors-can-reduce-your-local-s ...
Title: How NAP Errors Can Reduce Your Local Sea ... Description: Business owners often notice their websi ... H1: How NAP Errors Can Reduce Your Local Sea ... |
Canonical ≠ URL
Title too long
|
| 0 | 200 |
https://www.rankmefirst.ai/blog/what-chatgpt-can-check-in-an-seo-audit ...
Title: What ChatGPT Can Check in an SEO Audit a ... Description: No. ChatGPT can help you think through p ... H1: What ChatGPT Can Check in an SEO Audit a ... |
Canonical ≠ URL
Title too long
|
| 0 | 200 |
https://www.rankmefirst.ai/blog/how-to-compare-seo-agencies-before-you ...
Title: How to Compare SEO Agencies Before You C ... Description: Most business owners comparing SEO agenc ... H1: How to Compare SEO Agencies Before You C ... |
Canonical ≠ URL
|
| 0 | 200 |
https://www.rankmefirst.ai/blog/can-you-pay-for-seo-rankings-legitimat ...
Title: Can You Pay for SEO Rankings Legitimatel ... Description: Yes, paying for SEO is legitimate, but p ... H1: Can You Pay for SEO Rankings Legitimatel ... |
Canonical ≠ URL
Title too long
H1 too long
|
| 0 | 200 |
https://www.rankmefirst.ai/blog/why-traditional-seo-won-t-get-you-into ...
Title: Why Traditional SEO Won''t Get You Into ... Description: Appearing in Google AI Overviews require ... H1: Why Traditional SEO Won''t Get You Into ... |
Canonical ≠ URL
More than one H1 on page
Title too long
|
| 0 | 200 |
https://www.rankmefirst.ai/blog/how-to-check-local-recommendations-for ...
Title: How to Check Local Recommendations for a ... Description: There's an honest wrinkle in this questi ... H1: How to Check Local Recommendations for a ... |
Canonical ≠ URL
Title too long
|
| 0 | 200 |
https://www.rankmefirst.ai/blog/why-rankmefirst-ai-is-bonshaws-best-be ...
Title: Why RankMeFirst.ai Is Bonshaw''s Best Be ... Description: Understand six-signal framework that is ... H1: Why RankMeFirst.ai Is Bonshaw''s Best Be ... |
Canonical ≠ URL
Title too long
|
| 0 | 200 |
https://www.rankmefirst.ai/blog/what-is-geo/
Title: What is GEO and How is it Different from ... Description: GEO (Generative Engine Optimisation) get ... H1: What is GEO and How is it Different from ... |
Canonical ≠ URL
|