Googlebot FAQ
1. What types of Googlebot exist? Google has several crawlers and fetchers. They are built for different services and purposes. For us, SEOs, the main interest is in two: Googlebot Smartphone and Googlebot Desktop. Years ago, switching to mobile-first indexing was a hot topic, as it changed the crawl ratio between the two bots. However, […]
AI Bots: What They Crawl And Why
You attended Serge Bezborodov’s talk at brightonSEO San Diego.His session “AI Bots: What They Crawl and Why” is now available for download. Discover how AI-powered crawlers evaluate your site – and what SEOs must change to stay visible in the new AI-driven search era. How AI bots decide what to crawl and display Essential SEO […]
JetOctopus 2025: H1 Results & H2 Vision
At JetOctopus, we believe technical SEO should be fast, visual and actionable. In the first half of 2025, we stayed true to that mission – delivering powerful updates designed to give SEO professionals more control, deeper insights and tangible results. Now, we’re sharing a behind-the-scenes look at the journey so far and a sneak peek […]
Non-Canonical URLs Ranking: Case Studies, Stats and Best Practices
Large sites often use rel=canonical to signal the preferred version of duplicate or similar pages and prevent them form ranking in SERPs. SEO specialists state that googlebot very often ignores canonical tags on large e-commerce and enterprise sites, leading to hundreds or thousands of unwanted pages ranking instead of the intended URL. What are the […]
Log file integration: everything you need to know
Analyzing search engine logs is a core task for technical SEOs. Log files contain 100% accurate information about how search engines crawl your website, which makes log analysis indispensable for technical SEO strategy. However, analyzing raw logs with standard tools like Kibana, Datadog, or exporting them into CSV files can be frustrating and inefficient. That’s […]
Crawling big e-commerce websitess
Technical SEO for large e-commerce websites is one of the most challenging and rewarding areas in search marketing. You’re working with millions of URLs, historical issues, technical debt, and unexpected surprises, sometimes all at once. Crawling isn’t a “nice-to-have” in this environment. It’s a foundational activity that helps uncover deep technical problems and build a […]
How JetOctopus Handles Security and Data Privacy for Customers
The security and privacy of our customers’ data have been top priorities for JetOctopus since day one. The platform is built on three core principles:– Maximum data protection– Collection of only the minimum necessary data– Full transparency in data collection In the article below, we’ll dive into the details of how security is ensured across […]
Internal Linker Manual
What is JO Internal Linker JetOctopus Internal Linker is built to create an additional internal linking layer for large websites, addressing gaps in existing link structures. It identifies weak points by analyzing crawl budget, keyword data, and page performance from GSC, then generates the internal links needed to strengthen those areas. The core concept is […]
Internal Linking for big websites – the practical approach
Big websites operate at a different scale – millions of pages, little unique content, and complex structures. Unlike editorial sites, these pages lack EEAT, backlinks, and stable indexation due to dynamic factors like stock or filters. For SEOs, it’s a constant juggling act: rigid platforms, slow teams, and limited control – but the same pressure […]