Category: How to guides
May 30, 2022
by Sofia
JetOctopus represents a great opportunity to compare crawls. You can compare any crawls, not just the last two. This option is free and available to all users who use the...
May 27, 2022
by Sofia
5xx response codes indicate that the web server cannot process a request from the client. During the crawl, the JetOctopus user agent is a client. 5xx status code is not a sign...
May 26, 2022
by Sofia
While checking the crawl results, you may notice that some pages are missing. Therefore, it is very important to understand why JetOctopus did not find some pages because search...
May 25, 2022
by Sofia
You can run the crawl yourself or set up a regular crawl. Also, you can set the start of a one-time crawl at the time you need, for example, at night. With a regular crawl, you...
May 24, 2022
by Sofia
Using JetOctopus, you can find links to broken pages easily. Start a new crawl or check for broken links in the results of the previous crawl. However, keep in mind that the...
May 23, 2022
by Sofia
Orphan pages are URLs that cannot be found on your website during a crawl. They are not included in the structure of internal linking. As a consequence, users will not be able to...
May 20, 2022
by Sofia
Unique content is an essential factor in the ranking of your website in search results. If there is a lot of duplicate content, search engines may incorrectly identify the most...
May 19, 2022
by Sofia
Modern websites are very dynamic. They change frequently, URLs are updating, and websites have migrated to new domains. In all these cases, redirects are needed so that users and...
May 18, 2022
by Sofia
Sitemaps are one of the most important sources of new URLs for search engines. They scan URLs from sitemaps regularly. And if the URLs meet the requirements of search engines,...
May 17, 2022
by Sofia
If you crawl your website with a regular JetOctopus user agent, it will not be blocked by Cloudflare. However, if you want to check how your site is seen by Google bot using...
