Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
1 Sep 2026 7:2:46
Crawling time:00:00:12
Pages/Seconds1.7
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
Weight 0 | Status Code
200
| Url
https://mc.nathanpretty.com/guides/simplevoicechat/
Title: Simple Voice Chat Guide · Nathan’s Minec ... Description: Install and troubleshoot optional proxim ... H1: Simple Voice Chat | Issues
Canonical ≠ URL
|
Weight 0 | Status Code
200
| Url
https://mc.nathanpretty.com/guides/quickshop/
Title: QuickShop Guide · Nathan’s Minecraft Ser ... Description: Learn the basics of buying, selling, sto ... H1: QuickShop-Hikari | Issues
Canonical ≠ URL
|
Weight 0 | Status Code
200
| Url
https://mc.nathanpretty.com/privacy/
Title: Privacy · Nathan’s Minecraft Server Description: Learn what information the Minecraft ser ... H1: Privacy Policy | Issues
Canonical ≠ URL
|
Weight 0 | Status Code
200
| Url
https://mc.nathanpretty.com/discord/
Title: Discord Community · Nathan’s Minecraft S ... Description: Join Nathan’s gaming Discord and learn h ... H1: Gaming chat, Minecraft rooms, and a plac ... | Issues
Canonical ≠ URL
|
Weight 0 | Status Code
200
| Url
https://mc.nathanpretty.com/contact/
Title: Contact and Reports · Nathan’s Minecraft ... Description: Send a bug report, player report, genera ... H1: How can I help? | Issues
Canonical ≠ URL
|
Weight 0 | Status Code
200
| Url
https://mc.nathanpretty.com/guides/griefprevention/
Title: GriefPrevention Guide · Nathan’s Minecra ... Description: Learn how land claims protect your build ... H1: GriefPrevention | Issues
Canonical ≠ URL
|
Weight 0 | Status Code
200
| Url
https://mc.nathanpretty.com/guides/playerpoints/
Title: PlayerPoints Guide · Nathan’s Minecraft ... Description: Understand the simple PlayerPoints econo ... H1: PlayerPoints | Issues
Canonical ≠ URL
|
Weight 0 | Status Code
200
| Url
https://mc.nathanpretty.com/guides/
Title: Player Guides · Nathan’s Minecraft Serve ... Description: Beginner-friendly guides for claims, pla ... H1: Player Guides | Issues
Canonical ≠ URL
|
Weight 0 | Status Code
301
| Url
https://mc.nathanpretty.com/contact?type=ban_appeal
| Issues
301 Redirects
Redirect
|
Weight 0 | Status Code
200
| Url
https://mc.nathanpretty.com/contact/?type=ban_appeal
Title: Contact and Reports · Nathan’s Minecraft ... Description: Send a bug report, player report, genera ... H1: How can I help? | Issues
Canonical ≠ URL
|