When a page redirects back to itself, it means that the redirect location is the same as the redirecting page. For example, https://example.com/page-1 – 301 – https://example.com/page-1. An endless redirect loop will occur until the browser crashes. Using JetOctopus, you can quickly find pages with redirects back to itself. How do I check for URLs […]
As you know, internal linking is extremely important for users of your website and of course for search engines. All visitors, even artificial intelligence, want to access any page of your site in just a few clicks. And the simpler and clearer the path from the home page to the desired one, the better the […]
We are pleased to present to your attention an interesting dataset that will help you analyze your search metrics. How effective are your pages in search? How many clicks and impressions does a certain segment of pages receive for specific queries? What is the average position for each query in different countries? Now you don’t […]
If you have configured image crawling, but the results do not include all of them, there may be several reasons. Below we will tell you how to find out the reason. Understanding why there are missing images in the results is important, because search engines may not have access to all images either. Reason 1. […]
Internal linking is very important for search engines. Thanks to internal linking, search bots understand the structure of the website. Internal link anchors are also important. With the help of this text, search engines understand what the page is about. Of course, this is not the only thing that bots take into account when scanning […]
Search engines, especially Google, say that a lot of internal links on a page is not a good way to improve internal linking. If there are too many internal links, their value to search engines may decrease. The same situation with external links: if there are too many of them, search bots will reduce the […]
Every SEO specialist has heard about the terrible consequences of cannibalization at least once in his life. If two pages rank for the same query, it’s terrible, because users will get confused and click on the wrong page. And it will be difficult for search engines to figure out which page to rank in the […]
Security is important to all websites. For JetOctopus, the security of your data is also in the first place. Therefore, we want to tell you which user agents JetOctopus uses when scanning your website. DevOps or website administrators will also need this information so they don’t block the JetOctopus crawler. We emphasize that JetOctopus is […]
External links are links that contain a domain other than yours in <a href=> HTML element. The text of <a href=”https://external-domain.com/“>Text (anchor) to identify the external domain</a> is called an anchor. An anchor text will be displayed visually for the user. And after clicking on this text, the user will go to the external domain. […]
Website loading speed and performance are very important for search engines and users. Every year, the requirements for these metrics grow. One way to make a website faster is to optimize images. Lazy loading can help with this. However, how do you know which images are already lazy loaded and which are not? How to […]
We are pleased to present to you our big update: Keywords Groups tool. This is a new feature that will allow you to effectively analyze the performance of different groups of keywords. Create a group of keywords, for example, informational keywords (“how to”, “where to”, etc.) and monitor the dynamics of clicks, impressions, positions, CTR. […]
Google is one of the most popular search engines. Many SEO specialists closely follow the updates of algorithms of this search engine. In particular, a lot of attention is paid to changing the version of the browser with which the Googlebot imitates users. Also, the ratio of crawling performed by desktop and mobile robots is […]
JetOctopus recently had a great update: the ability to configure alerts became available. All our clients can set up an unlimited number of alerts for free in 4 sections: logs, Google Search Console, Crawl and Core Web Vitals. In this article, we will explain how alerts work, how to configure them, and show several examples […]
The frequency of crawling of different subdomains by search engines may differ. This may depend on the indexing settings, the robots.txt file (for each subdomain there must be a separate robot.txt), correctly formed sitemaps, etc. But in addition to the domains open for indexing and scanning, the logs may contain technical, staging, and other subdomains […]
Ajax URLs may not be displayed correctly in search results because they are an asynchronously processed part of the page that depends on user action. Although the Ajax URLs have a different address, the content may be identical with the main page. Therefore, it is necessary to ensure that search bots do not scan Ajax […]
5xx response codes indicate a broken web server. These status codes are usually temporary. However, a large number of 5xx and regular repeats can affect the crawling of your website by search engines. Why do you need to monitor 5xx response codes? First, Google search engines will slow down the crawling of your website if […]
You may have noticed that the number of crawled URLs in the Google Search Console “Crawl stats” report may differ from the number of URLs visited by search engines that you see from the JetOctopus logs. Why this is so and how to correctly count the number of visited pages, read in this article. 1. […]
Custom extraction is needed to find certain elements in the HTML code of the page. Our web scraper will search selected elements while crawling your website. With custom extraction, you can use JetOctopus more efficiently and get non-standard information about your website. With JetOctopus, you can configure up to 50 custom extraction rules during a […]
If search engines receive a lot of 404 response codes, they can reduce the scanning frequency of your website. Also, 404 in the logs can indicate the following problems: Also, 404 response codes in the logs can highlight problems with the site or web pages that broke due to releases, updates, etc. How to find […]
You may meet a situation when you check a page that returned a 4xx or 5xx response code to the search engine (you found this data in the logs). And when checking manually, the page returns a 200 response code. What could be the reason for such a situation? 1. In the logs, you can […]
Regular scanning of the website by search robots ensures the updating of data in the index. The regularly crawled pages will also have an up-to-date snippet in the SERP. However, sometimes crawling is excessive and can cause server overload. If your website is popular and constantly updated, extreme crawling by search engines can even lead […]
Get exclusive tech SEO insights
