What types of Googlebot exist? Just a couple of years ago, Python was a hot topic: “Python for technical SEO”, “Python for log file analysis”, “Making friends with Python”. But suddenly, in late 2022, everything changed with the introduction of ChatGPT-3. Instead of spending a long evening writing code to process a CSV file, now […]
17 November, JetOctopus and OMcollective gathered the SEO community in Ghent to answer one question:How is AI reshaping search and what must SEOs do to stay visible in 2025 and beyond?Across multiple expert sessions, one insight became clear:Search is no longer Google-only and AI has fundamentally changed how content is discovered. Below are the 7 […]
1. What types of Googlebot exist? Google has several crawlers and fetchers. They are built for different services and purposes. For us, SEOs, the main interest is in two: Googlebot Smartphone and Googlebot Desktop. Years ago, switching to mobile-first indexing was a hot topic, as it changed the crawl ratio between the two bots. However, […]
You attended Serge Bezborodov’s talk at brightonSEO San Diego.His session “AI Bots: What They Crawl and Why” is now available for download. Discover how AI-powered crawlers evaluate your site – and what SEOs must change to stay visible in the new AI-driven search era. How AI bots decide what to crawl and display Essential SEO […]
At JetOctopus, we believe technical SEO should be fast, visual and actionable. In the first half of 2025, we stayed true to that mission – delivering powerful updates designed to give SEO professionals more control, deeper insights and tangible results. Now, we’re sharing a behind-the-scenes look at the journey so far and a sneak peek […]
Large sites often use rel=canonical to signal the preferred version of duplicate or similar pages and prevent them form ranking in SERPs. SEO specialists state that googlebot very often ignores canonical tags on large e-commerce and enterprise sites, leading to hundreds or thousands of unwanted pages ranking instead of the intended URL. What are the […]
Analyzing search engine logs is a core task for technical SEOs. Log files contain 100% accurate information about how search engines crawl your website, which makes log analysis indispensable for technical SEO strategy. However, analyzing raw logs with standard tools like Kibana, Datadog, or exporting them into CSV files can be frustrating and inefficient. That’s […]
What is JO Internal Linker JetOctopus Internal Linker is built to create an additional internal linking layer for large websites, addressing gaps in existing link structures. It identifies weak points by analyzing crawl budget, keyword data, and page performance from GSC, then generates the internal links needed to strengthen those areas. The core concept is […]
Big websites operate at a different scale – millions of pages, little unique content, and complex structures. Unlike editorial sites, these pages lack EEAT, backlinks, and stable indexation due to dynamic factors like stock or filters. For SEOs, it’s a constant juggling act: rigid platforms, slow teams, and limited control – but the same pressure […]
The robots.txt file is a set of instructions (directives) for search engines and other web crawlers that visit your website. Using the robots.txt file, you can prevent bots from scanning (visiting) your website or its individual pages or subfolders. If the file is incorrectly configured, whether accidentally or due to a technical error, the entire […]
Crawling and discovering a page by search bots is the basic and very first stage for recieving organic traffic. If you want the page to appear in Google or other search engines’ results, it must be available for crawling. If an important page is blocked from crawling, it won’t appear in the SERP. One of […]
In this article, we will explore the reasons behind discrepancies in the “Page Indexing” report of Google Search Console – why the reported number of pages might exceed crawling results, or conversely, why it could be fewer. Analyzing these issues can be instrumental in detecting and promptly rectifying problems with indexing. Why were fewer pages […]
In this article, we will guide you on what to do if you encounter redirect chains while scanning your website. Redirect chains occur when a page redirects the client’s browser to another page, and then another, and then another. The number of redirects in a chain can be quite large; if it is more than […]
In this article, we will guide you on how to handle old content: whether to archive it, delete it, or keep it on your website. What to do with old content? When dealing with outdated or old content, there are various approaches to consider. The first option is to delete the content entirely, while the […]
In this article, we will delve into the crucial role that CSS/stylesheets play in search engine optimization (SEO). Understanding their impact and learning how to effectively analyze them can greatly contribute to optimizing your website’s performance and visibility in search engine results. Why is it important to check CSS and stylesheets files? CSS and Stylesheets […]
Pagination pages play a crucial role in the structure of websites, providing users with organized access to a large amount of content. However, if these pages aren’t properly managed for indexability or proper crawling permissions through robots.txt, it can lead to decreased visibility on search engines. Similarly, if the pagination is 404, then this can […]
In this article, we will tell you what to do if, during the analysis of the logs, you notice a sudden drop in the frequency of scanning and the number of visits of search engines. Discover potential issues and solutions to ensure your website’s optimal visibility. Check log integration with JetOctopus The initial step involves […]
Performing a content audit might not seem inherently technical within the realm of SEO, but it holds immense potential when utilizing data from technical SEO aspects. In this article, we’ll delve into the process of conducting a content audit using data extracted from JetOctopus, a powerful SEO tool that can unlock a wealth of insights. […]
One invaluable tool for proactive website management is JetOctopus’ GSC Inspection Alerts. In this article, we’ll explore the significance of these alerts, delve into the process of setting them up, and illustrate their impact on maintaining SEO health. Understanding GSC inspection alerts GSC Inspection Alerts, an essential feature of JetOctopus, empowers website owners and SEOs […]
Analyzing the data of the “Page indexing” report in Google Search Console, you may come across the “Redirect error” issue as one of the reasons why pages are not being indexed. This article aims to elucidate the causes of such problems, provide guidance on analyzing them, and offer solutions for rectifying redirect-related issues. Understanding the […]
Undoubtedly, sitemaps are an exceedingly potent tool for optimizing your website’s SEO. SEO specialists universally rely on sitemaps to signal search engines about crucial pages deserving indexing. Nonetheless, pitfalls can arise. Sitemaps turn detrimental when they incorporate broken URLs, non-indexable URLs, or pages obstructed by robots.txt directives. What does it mean for search engines if […]
Get exclusive tech SEO insights
