Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
11 Jul 2026 21:50:8
Crawling time:00:02:12
Pages/Seconds1.5
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://decklistdata.com/duel-commander/league/2026-07-02-0210716
Title: Duel Commander League — Jul 2 — Decklist ... Description: Full decklists from Duel Commander Leagu ... H1: Duel Commander League |
Description too short
|
| 0 | 200 |
https://decklistdata.com/duel-commander/league/2026-07-10-1010716
Title: Duel Commander League — Jul 10 — Decklis ... Description: Full decklists from Duel Commander Leagu ... H1: Duel Commander League |
Description too short
|
| 0 | 200 |
https://decklistdata.com/duel-commander/decks/nick-fury-agent-of-s-h-i ...
Title: Pasdejambon · Nick Fury, Agent of S.H.I. ... Description: Pasdejambon's Nick Fury, Agent of S.H.I. ... H1: Nick Fury, Agent of S.H.I.E.L.D. |
Meta Noindex Pages
Title too long
|
| 0 | 200 |
https://decklistdata.com/duel-commander/league/2026-07-09-0910716
Title: Duel Commander League — Jul 9 — Decklist ... Description: Full decklists from Duel Commander Leagu ... H1: Duel Commander League |
Description too short
|
| 0 | 200 |
https://decklistdata.com/duel-commander/decks/mister-fantastic/damiena ...
Title: damienade · Mister Fantastic — Duel Comm ... Description: damienade's Mister Fantastic at Duel Com ... H1: Mister Fantastic |
Meta Noindex Pages
Description too short
|
| 0 | 200 |
https://decklistdata.com/duel-commander/league/2026-07-07-0710716
Title: Duel Commander League — Jul 7 — Decklist ... Description: Full decklists from Duel Commander Leagu ... H1: Duel Commander League |
Description too short
|
| 0 | 200 |
https://decklistdata.com/duel-commander/decks/niv-mizzet-reborn/hyyy1- ...
Title: hyyy1 · Niv-Mizzet Reborn — Duel Command ... Description: hyyy1's Niv-Mizzet Reborn at Duel Comman ... H1: Niv-Mizzet Reborn |
Meta Noindex Pages
Description too short
|
| 0 | 200 |
https://decklistdata.com/duel-commander/decks/king-tchalla/Damgar-2026 ...
Title: Damgar · King T''Challa — Duel Commander ... Description: Damgar's King T'Challa at Duel Commander ... H1: King T''Challa |
Meta Noindex Pages
Description too short
|
| 0 | 200 |
https://decklistdata.com/duel-commander/league/2026-06-28-2810716
Title: Duel Commander League — Jun 28 — Decklis ... Description: Full decklists from Duel Commander Leagu ... H1: Duel Commander League |
Description too short
|
| 0 | 200 |
https://decklistdata.com/duel-commander/decks/king-tchalla/BranzaDoppi ...
Title: BranzaDoppioMalto · King T''Challa — Due ... Description: BranzaDoppioMalto's King T'Challa at Due ... H1: King T''Challa |
Meta Noindex Pages
Title too long
Description too short
|