Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
31 Jul 2026 15:25:17
Crawling time:00:01:37
Pages/Seconds2.1
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://api.nntu.ru/news/detail/zhizn-api-ngtu/anonsy-meropriyatii/zim ...
Title: Зимняя школа студенческого актива | АПИ ... Description: [empty] H1: Зимняя школа студенческого актива |
Description is empty
Canonical is missing
|
| 0 | 200 |
https://api.nntu.ru/news/detail/zhizn-api-ngtu/obyavleniya/den-otkryty ...
Title: День открытых дверей АПИ НГТУ онлайн | А ... Description: [empty] H1: День открытых дверей АПИ НГТУ онлайн |
Description is empty
Canonical is missing
|
| 0 | 302 |
https://api.nntu.ru/news/index?links=zhizn-api-ngtu/vse-novosti&page=4 ...
|
Non-301 Redirects
302 Redirects
Redirect
|
| 0 | 302 |
https://api.nntu.ru/news/index?links=zhizn-api-ngtu/vse-novosti&page=2 ...
|
Non-301 Redirects
302 Redirects
Redirect
|
| 0 | 302 |
https://api.nntu.ru/news/index?links=zhizn-api-ngtu/vse-novosti&page=4 ...
|
Non-301 Redirects
302 Redirects
Redirect
|
| 0 | 200 |
https://api.nntu.ru/news/detail/zhizn-api-ngtu/anonsy-meropriyatii/den ...
Title: День открытых дверей АПИ НГТУ | АПИ НГТУ ... Description: [empty] H1: День открытых дверей АПИ НГТУ |
Description is empty
Canonical is missing
|
| 0 | 200 |
https://api.nntu.ru/news/detail/pozdravleniya/vse-novosti/obrashhayas- ...
Title: Обращаясь к истокам | АПИ НГТУ Description: [empty] H1: В АПИ завершен проект "Обращаясь к исток ... |
Description is empty
Canonical is missing
|
| 0 | 200 |
https://api.nntu.ru/news/detail/pozdravleniya/vse-novosti/ekskursionna ...
Title: Экскурсионная поездка в Муром | АПИ НГТУ ... Description: [empty] H1: Экскурсионная поездка в Муром |
Description is empty
Canonical is missing
|
| 0 | 200 |
https://api.nntu.ru/news/detail/pozdravleniya/vse-novosti/v-arzamassko ...
Title: В Арзамасском историко-художественном му ... Description: [empty] H1: В Арзамасском историко-художественном му ... |
Description is empty
Canonical is missing
|
| 0 | 200 |
https://api.nntu.ru/news/detail/pozdravleniya/vse-novosti/studenty-api ...
Title: Студенты АПИ совершили паломническую пое ... Description: [empty] H1: Студенты АПИ совершили паломническую пое ... |
Title too long
Description is empty
Canonical is missing
|