5xx response codes indicate a broken web server. These status codes are usually temporary. However, a large number of 5xx and regular repeats can affect the crawling of your website by search engines. Why do you need to monitor 5xx response codes? First, Google search engines will slow down the crawling of your website if […]
You may have noticed that the number of crawled URLs in the Google Search Console “Crawl stats” report may differ from the number of URLs visited by search engines that you see from the JetOctopus logs. Why this is so and how to correctly count the number of visited pages, read in this article. 1. […]
Using JetOctopus, you can find pages containing mixed types of URLs – with HTTP and HTTPS protocol. Google and other search engines recommend using the HTTPS protocol because it is more secure. Most sites have migrated, but not all managed to replace HTTP URLs in the code. This can become a problem if no redirects […]
Custom extraction is needed to find certain elements in the HTML code of the page. Our web scraper will search selected elements while crawling your website. With custom extraction, you can use JetOctopus more efficiently and get non-standard information about your website. With JetOctopus, you can configure up to 50 custom extraction rules during a […]
Pages with HTML full duplication are URLs that contain identical content, including full duplicated headings, titles, and metadata, HTML-elements. If these pages are open for indexing, search engines will not be able to select which page to display in SERP. As a result, the page that should not be in SERP may appear there. With […]
In the work of SEO, it is important to track the pages that just appeared in SERP. These can be both newly created pages and already existing pages that have dropped out of the index or were not displayed in the SERP due to technical or indexation problems. Due to the analysis of the most […]
Merging data from different tables is much more convenient if you use the “Join Dataset” tool. You can use this option in all data tables: logs, Google Search Console and crawl. In this way, you can merge the data from the crawl or logs with the most effective pages in the GSC. You will find […]
If your website is perfectly on-page optimized, but the search engines get a lot of non-200 response codes, this can decrease the crawling budget. Search engines will crawl your website less often, pages will be updated less often in the SERP, and new ones will be shown with a lag. To avoid this, we recommend […]
We offer several options if you want to share a JetOctopus report with your colleagues. Choose the most convenient way depending on what your needs are. 1. Share the PDF file. This is the easiest way to share all charts from any menu with your colleagues. You can save reports from the “Logs”, “Crawler”, “GSC” […]
Get exclusive tech SEO insights
