Category: How to guides
May 18, 2022
by Sofia
Sitemaps are one of the most important sources of new URLs for search engines. They scan URLs from sitemaps regularly. And if the URLs meet the requirements of search engines,...
May 17, 2022
by Sofia
If you crawl your website with a regular JetOctopus user agent, it will not be blocked by Cloudflare. However, if you want to check how your site is seen by Google bot using...
May 16, 2022
by Sofia
JetOctopus can crawl staging websites and websites closed from scanning by search engines. You can also run a crawl of a website that needs authentication (password/login). To...
May 13, 2022
by Sofia
Indexability is one of the most important characteristics to pay attention to when analyzing crawling results. We've created a separate segment to make work with indexable pages...
May 12, 2022
by Sofia
Core Web Vitals is a set of specific features that Google considers important for users. The better your Core Web Vitals, the better your site is at the top in the SERP. Core Web...
May 10, 2022
by Sofia
Hreflang attributes show search engines that a website has localized versions of pages. For example, you may have English and Ukrainian versions, or separate English language...
May 9, 2022
by Sofia
If you find errors in crawl results or logs, you can submit the corrected/updated pages for scanning to search engines. This can be done with a custom sitemap. JetOctopus allows...
May 6, 2022
by Sofia
Happens when you run a crawl and the website returns a 503 response code. “503 Service Unavailable” response code means that your web server cannot process the request at this...
May 4, 2022
by Sofia
JetOctopus can find redirect chains on your site. What is a redirect chain? This is a sequence of several redirects. For example, from URL1 to URL2, from URL2 to URL3, and so on...
May 2, 2022
by Sofia
Before you start a new crawl we recommend preparing basic information about your website. It allows you to set up the optimal configuration of the crawl. Of course, the basic...
