Visiblio / Technical SEO Crawler
Crawl a single page or an entire site, like a search engine would.
Visiblio visits the addresses with the user agent you choose, records what the server says and what is in the HTML, and reports what could stop Google from reaching, indexing or understanding your pages. Everything is factual: each issue lists the exact addresses behind it.
Audit any public page, yours or a competitor's: status and redirects, every on-page check, headers, links, images, structured data and the issues found, each explained with how to fix it.
Start from a web address and crawl a few pages or the entire site (up to 25,000 pages): by following links, from the sitemap, or both. Choose the user agent, the limits and what to skip under Crawl settings.
Crawl settings
Save a website and Visiblio checks it by itself once a week: it reads the sitemap (or the home page links), visits a spread of pages, and looks at status codes, redirects, noindex, canonicals, titles, headings, robots.txt and mobile speed. Each result is compared with the week before, so you see what broke, what got fixed and how the health score moved, without opening a tool.
Up to 5 websites. Each weekly audit checks about 18 pages (the home page and an even spread) so it stays within the free limits, and the last 8 weeks are kept. It only sees what any visitor can see: no Google sign-in is used or stored. For every page, crawl the whole website here.
How this works and what it can and cannot do
- The crawler asks for each address with the user agent you choose, follows redirects one step at a time, and reads the HTML it gets back. It records status codes, redirect paths, secure headers, size and speed, and the page's own tags: title, description, robots directives, canonical, hreflang, headings, images, links, structured data and accessibility markup.
- Pages are not rendered with JavaScript, so content, links or tags added by scripts are not seen. A warning says so when a page looks built with JavaScript.
- Every issue shows what it means, how to fix it and the addresses behind it.
- Choosing Googlebot or another search engine user agent shows what the site serves to that crawler. Some sites verify the real Google address and refuse copies, so a block here does not prove Google is blocked.
- Signed-in team members can run full-site crawls (up to 25,000 pages in one crawl, about 60,000 addresses an hour). Large crawls use your browser's memory, so keep the tab open and pick Gentle speed for fragile websites.
- Your last settings are remembered in this browser only. Nothing you crawl is stored on a server.
Crawling…
Starting…