Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
3 Aug 2026 13:54:38
Crawling time:00:01:36
Pages/Seconds2.1
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://rediscoversrilanka.com/sri-lanka-the-finest-island-of-its-size ...
Title: Sri Lanka: The Finest Island of Its Size ... Description: When Marco Polo first set eyes on Sri La ... H1: Sri Lanka: The Finest Island of Its Size ... |
More than one H1 on page
Title too long
|
| 0 | 200 |
https://rediscoversrilanka.com/luxury-tour-operators-for-unique-experi ...
Title: Luxury Tour Operators for Unique Experie ... Description: When it comes to luxury travel, discerni ... H1: Luxury Tour Operators for Unique Experie ... |
Title too long
Description too long
|
| 0 | 200 |
https://rediscoversrilanka.com/sri-lanka-luxury-travel-guide/
Title: Why Sri Lanka Is Quietly Becoming Asia’s ... Description: Sri Lanka's luxury travel scene has arri ... H1: Why Sri Lanka Is Quietly Becoming Asia’s ... |
Title too long
|
| 0 | 200 |
https://rediscoversrilanka.com/discover-the-magic-of-sri-lanka-with-th ...
Title: Discover the Magic of Sri Lanka with the ... Description: Sri Lanka, an island of unparalleled bea ... H1: Discover the Magic of Sri Lanka with the ... |
Title too long
Description too long
|
| 0 | 200 |
https://rediscoversrilanka.com/privet-spasibo-sri-lanka-sinhala/
Title: Как сказать привет и спасибо на Шри-Ланк ... Description: Узнайте, как правильно приветствовать лю ... H1: Как сказать привет и спасибо на Шри-Ланк ... |
More than one H1 on page
Title too long
H1 too long
|
| 0 | 200 |
https://rediscoversrilanka.com/eco-friendly-travel-in-sri-lanka-explor ...
Title: Eco-Friendly Travel in Sri Lanka: Explor ... Description: Rediscover Sri Lanka specializes in cura ... H1: Eco-Friendly Travel in Sri Lanka: Explor ... |
Title too long
|
| 0 | 200 |
https://rediscoversrilanka.com/luxury-travel-in-sri-lanka-discover-opu ...
Title: Luxury Travel in Sri Lanka Discover Opul ... Description: Luxury Travel in Sri Lanka a gem in the ... H1: Luxury Travel in Sri Lanka Discover Opul ... |
Title too long
|
| 0 | 200 |
https://rediscoversrilanka.com/bonjour-merci-sri-lanka-guide-singhalai ...
Title: Bonjour et merci en cingalais : guide co ... Description: Comment dire bonjour et merci au Sri Lan ... H1: Bonjour et merci en cingalais : guide co ... |
More than one H1 on page
Title too long
H1 too long
|
| 0 | 200 |
https://rediscoversrilanka.com/sri-lanka-ayurveda-urlaub-2026-die-ulti ...
Title: Sri Lanka Ayurveda Urlaub 2026: Die ulti ... Description: Entdecke den perfekten Sri Lanka Ayurved ... H1: Sri Lanka Ayurveda Urlaub 2026: Die ulti ... |
Title too long
H1 too long
|
| 0 | 200 |
https://rediscoversrilanka.com/how-to-find-a-reliable-vehicle-with-dri ...
Title: How to Find a Reliable Vehicle with Driv ... Description: Tour in Sri Lanka is an unforgettable ex ... H1: How to Find a Reliable Vehicle with Driv ... |
Title too long
|