Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
25 Jun 2026 10:52:22
Crawling time:00:01:30
Pages/Seconds2.2
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://www.justiceinitiative.org/voices/q-and-a-how-putin-could-be-pu ...
Title: Vladimir Putin Must Be Put on Trial for ... Description: James A. Goldston, executive director of ... H1: Q&A: How Putin Could Be Put on Trial for ... |
Title too long
Canonical is missing
|
| 0 | 200 |
https://www.justiceinitiative.org/voices/a-legal-victory-in-the-drive- ...
Title: Victory in Ending Racist Police Tactics ... Description: Mohamad Wa Baile, a Swiss citizen, compl ... H1: A Legal Victory in the Drive to End Raci ... |
Title too long
Canonical is missing
|
| 0 | 200 |
https://www.justiceinitiative.org/contact
Title: Contact us - Open Society Justice Initia ... Description: [empty] H1: General Inquiry |
Canonical is missing
Description is missing
|
| 0 | 200 |
https://www.justiceinitiative.org/voices/q-and-a-safeguarding-human-ri ...
Title: Q&A: Safeguarding Human Rights in Detent ... Description: Two human rights lawyers in Argentina sh ... H1: Q&A: Safeguarding Human Rights in Detent ... |
Long URLs
Title too long
H1 too long
Canonical is missing
|
| 0 | 200 |
https://www.justiceinitiative.org/newsroom/african-court-calls-on-nati ...
Title: African Court Calls on Nations to Bolste ... Description: All African Union Member States have a d ... H1: African Court Calls on Nations to Bolste ... |
Long URLs
Title too long
H1 too long
Canonical is missing
|
| 0 | 200 |
https://www.justiceinitiative.org/newsroom/eu-top-court-strikes-down-h ...
Title: Top EU Court Strikes Down 2018 Hungarian ... Description: The EU’s top court has found that a 2018 ... H1: EU Top Court Strikes Down Hungarian “Sto ... |
Title too long
Canonical is missing
|
| 0 | 200 |
https://www.justiceinitiative.org/newsroom/justice-initiative-files-co ...
Title: Justice Initiative Files Complaint again ... Description: The Open Society Justice Initiative has ... H1: Justice Initiative Files Complaint again ... |
Long URLs
Title too long
H1 too long
Canonical is missing
|
| 0 | 200 |
https://www.justiceinitiative.org/litigation/open-society-institute-bu ...
Title: Open Society Institute–Budapest v. Hunga ... Description: [empty] H1: Open Society Institute–Budapest v. Hunga ... |
Title too long
Canonical is missing
Description is missing
|
| 0 | 200 |
https://www.justiceinitiative.org/litigation?filter_topic=12
Title: Open Society Justice Initiative—Litigati ... Description: Open Society Justice Initiative lawyers ... H1: [empty] |
Title too long
H1 is missing
Canonical is missing
|
| 0 | 200 |
https://www.justiceinitiative.org/litigation/elections-in-africa-durin ...
Title: Elections in Africa during the COVID-19 ... Description: [empty] H1: Elections in Africa during the COVID-19 ... |
Title too long
Canonical is missing
Description is missing
|