New and improved crawl stats in your web site

Tuesday, November 24, 2020

To assist web site house owners higher perceive how Googlebot
crawls their websites, we’re launching a model new model of the Crawl stats report
in Search Console.

The brand new Crawl Stats report brings the next thrilling new options:

1. Whole variety of requests grouped by response code, crawled file kind, crawl goal, and Googlebot kind.
2. Detailed data on host standing
3. URL examples to indicate the place in your web site requests occurred
4. Complete abstract for properties with a number of hosts and assist for area properties

Over-time charts

The Crawl Stats report allows web site house owners to see Google crawl knowledge totals and extra time charts for: complete requests,
complete obtain dimension and common response time.

Grouped crawl knowledge

The brand new model of the report additionally offers knowledge on crawl requests damaged down by response, file kind of the fetched URL,
goal of the crawl request, and Googlebot agent. See instance URLs of every kind by clicking on a row within the grouping desk:

Excessive stage and detailed data on host standing points

Host standing particulars within the report allow you to examine your web site’s normal availability to Google within the final 90 days.

For area properties with a number of hosts, you possibly can examine the host standing for every of the highest hosts offered within the report abstract view.
This might help you consider efficiency of all hosts underneath your area in a single place.

In abstract, the brand new Crawl stats report will provide help to perceive how Googlebot crawls your web site:

• See Google’s crawling historical past within the extra time charts
• See the file sorts and file sizes returned by your web site
• See crawl requests particulars within the instance lists
• Observe your web site’s availability points within the host standing view

We hope you discover the brand new knowledge helpful and actionable. For questions or feedback on the report, you possibly can
drop by our Search Central assist group,
or point out us on Twitter. And ensure to examine
the Crawl stats report documentation,
it has numerous particulars on what you are able to do with the brand new report.

Posted by Hillel Maoz, Engineering lead for Search Console