July 21, 2022
by Sofia
How to analyze logs by subdomains
The frequency of crawling of different subdomains by search engines may differ. This may depend on the indexing settings, the robots.txt file (for each subdomain there must be a...
July 20, 2022
by Sofia
How to check Ajax URLs in logs
Ajax URLs may not be displayed correctly in search results because they are an asynchronously processed part of the page that depends on user action. Although the Ajax URLs have...
July 19, 2022
by Sofia
How to check 5xx URLs in logs
5xx response codes indicate a broken web server. These status codes are usually temporary. However, a large number of 5xx and regular repeats can affect the crawling of your...
July 18, 2022
by Sofia
Why is a different number of logs displayed in GSC and in your logs?
You may have noticed that the number of crawled URLs in the Google Search Console “Crawl stats” report may differ from the number of URLs visited by search engines that you see...
July 8, 2022
by Sofia
How to audit non-200 response codes in search engine logs
If your website is perfectly on-page optimized, but the search engines get a lot of non-200 response codes, this can decrease the crawling budget. Search engines will crawl your...
July 6, 2022
by Sofia
Step-by-step instructions: analysis of 404 URLs in search engine logs
If search engines receive a lot of 404 response codes, they can reduce the scanning frequency of your website. Also, 404 in the logs can indicate the following problems...
July 5, 2022
by Sofia
Web page returned non 200 to search bot. Why do I get a different response code while manual checking?
You may meet a situation when you check a page that returned a 4xx or 5xx response code to the search engine (you found this data in the logs). And when checking manually, the...
July 4, 2022
by Sofia
How to find out the frequency of scanning by search robots
Regular scanning of the website by search robots ensures the updating of data in the index. The regularly crawled pages will also have an up-to-date snippet in the SERP. However,...
June 30, 2022
by Sofia
How to audit 304 pages visited by GoogleBot/other bots
When the search robot user-agent requests the web page using the header "If-Modified-Since" or "If-None-Match" and the page has not changed since the requested time (usually this...
June 29, 2022
by Sofia
How to find the slowest pages visited by search engines
Page load time affects how often your website is crawled by search engines. The slower the pages, the less often the search engine will visit them. That is, pages that respond...



Find technical SEO errors at your website at free trial
Get exclusive tech SEO insights
We are tech SEO geeks who believe that SEO is predictable and numeric. Don’t miss our insigths!