How to use custom robots.txt to make the crawl more efficient
As you know, you can use a custom robots.txt file when configuring a crawl. This is a useful option if, for example, you want to scan a staging website. But there are other advantages of using a custom robots.txt file during crawl settings. In this article, we will tell you how to make the most […]
How to view a website as a Googlebot using JetOctopus
When auditing a website, it is very important to understand how Googlebot views your website. After all, it sometimes happens that due to specific server settings, search engines view a different version of the page than users. In this article, we will tell you how to view a website as a Googlebot using JetOctopus. In […]
Product Update. GSC Discover: dive deep into recommendations analysis
The JetOctopus team made a great and handy update: now all clients can analyze the effectiveness of their pages in Google Discover. What is Google Discover? Google Discover is personalized recommendations for Google users. You can see recommended articles and news both on your smartphone and on Google’s desktop services if you use them. Based […]
How to use the “Query on Page” dataset for an SEO boost
The “Query on Page” dataset is one of the best tools that will help improve your website’s rankings in search results. By analyzing this data, you can delve into the analysis of real user queries and whether your website pages have relevant metadata, headings, etc. For example, users may search for “green pencil”, but you […]
How to recrawl pages unable to load by timeout
When configuring the crawl, you can set up the desired timeout. However, this setting is only necessary if a very gentle and slow crawl is desired. Otherwise, there will be a standard 10 seconds timeout. Most browsers also use a 10 seconds timeout. This means that the crawler (and clients’ browsers) will wait no more […]
6 hidden features: how to use JetOctopus more effectively
JetOctopus is a comprehensive tool for SEO that has many advantages and cool features. We would like to remind you about several cool features that will help you use JetOctopus more effectively. Thanks to these tools, you will be able to analyze the website in less time. And you will be able to find technical […]
Insights from GSC: how to use this dashboard to create an SEO strategy
When creating an SEO strategy, it is important to understand the general trends on the website, its strengths and weaknesses. Which URLs bring the most traffic? How does it relate to the position of the page in SERP? Does the query matter? Many questions arise, the answers to which you can find in Google Search […]
Sum up for the six months of 2022
The last six months have been interesting and exciting for the JetOctopus team. It was difficult at times, but we managed it. And as a result, many useful updates were released. As we know, our beloved customers are actively using many new features. We are happy to improve JetOctopus and make it more convenient for […]
How to use Include and Exclude settings when configuring a crawl
Use the Include and Exclude feature to prevent JetOctopus from scanning unwanted pages. We recommend that you use this option if you need to scan one or more types of pages. You can use this feature if you need to scan a part of the large website. Read about other ways to scan a large […]