Rel=”canonical” is a powerful method that allows you to manage duplicate content. When you use the canonical, you tell search engines which page to show in search results. However, there are situations when due to the incorrect use of the canonicals, unwanted pages are displayed in the search results or, conversely, the most important ones […]
JetOctopus represents a great opportunity to compare crawls. You can compare any crawls, not just the last two. This option is free and available to all users who use the JetOctopus crawling tool. LINK TO THE HOME Read about the benefits of our crawl comparison tool in the article āProduct Update: Compare Crawlsā. How to […]
5xx response codes indicate that the web server cannot process a request from the client. During the crawl, the JetOctopus user agent is a client. 5xx status code is not a sign that the URL is incorrect or broken. This only indicates that the web server could not respond when the server received this request […]
While checking the crawl results, you may notice that some pages are missing. Therefore, it is very important to understand why JetOctopus did not find some pages because search engines are just as difficult to find these pages when crawling your site. Why JetOctopus didnāt find all the pages To understand why JetOctopus did not […]
You can run the crawl yourself or set up a regular crawl. Also, you can set the start of a one-time crawl at the time you need, for example, at night. With a regular crawl, you can track changes to your website after releases, the number of new pages created over a while, and more. […]
Using JetOctopus, you can find links to broken pages easily. Start a new crawl or check for broken links in the results of the previous crawl. However, keep in mind that the number of broken links may have changed since the last crawl. Links to broken pages are the links that lead to non-200 pages. […]
Orphan pages are URLs that cannot be found on your website during a crawl. They are not included in the structure of internal linking. As a consequence, users will not be able to find these pages. But search engines can follow the orphan pages from external links, from search index (for example, if the orphan […]
Unique content is an essential factor in the ranking of your website in search results. If there is a lot of duplicate content, search engines may incorrectly identify the most relevant page or exclude duplicate content URLs from search results. However, the most important thing is that duplications are wasting your crawling budget. A lot […]
Modern websites are very dynamic. They change frequently, URLs are updating, and websites have migrated to new domains. In all these cases, redirects are needed so that users and search engines can find the right URLs. If redirects are missing or not working properly, you may lose conversions and the URLs will drop out of […]
Get exclusive tech SEO insights
