You can choose several scanning modes: scanning the entire website, scanning URLs from sitemaps or crawling pages from a list. Crawl list mode is very useful when you need to check metadata, status codes, load time and get other data about specific pages. It’s a very handy tool, but there are a few life hacks […]
In this article, we will tell you how to crawl large websites with millions of pages. With the help of different settings, you will be able to crawl your website most efficiently and get reliable results. Running a full crawl of your website is a great idea to apply the results to your entire website. […]
Being a bit competitive is always a good thing, especially in business. Keeping an eye on your top rivals — what they’re doing, how they’re doing it, and the output of their efforts — spurs innovation, discourages complacency, and provides inspiration to improve. The same holds true in SEO. Whether your website is ranking on […]
It has already become a tradition — to reflect on the results of the past year. Dear customers and colleagues, we are happy to share with you how well we fared in 2021. The volume of data processed since our inception (2018) log lines: 80bln crawled pages: 20bln websites: 40k Our customers Our customer geography […]
Have you ever had a chance to look into the live tail of your website’s access log? You’d expect to see a lot of different user-agents of users’ browsers on your website. But more likely, you’ll find a variety of bots. What is bot traffic? In simple words, when a user uses an internet browser […]
With each update, Google’s ranking algorithm is becoming increasingly smarter in determining the quality of content and user experience on websites. Sure, time-tested SEO tactics such as link building and keywords optimization aren’t going anywhere anytime soon — and you must continue working on these as usual — but there are certain SEO trends worth […]
DOM.RIA.com is a Ukrainian real estate marketplace. Thousands of ads for the sale and rent of real estate are added to the site every day. As the site structure is large and complex, to ensure the freshness and relevance of content appearing in Google search, there was a need to maximize the crawl efficiency of […]
Blog posts and guides bring traffic to the top of the funnel. Product pages bring buyers. That is why SEO for ecommerce product pages pays back faster than almost any other work on a large catalog: the searcher already knows what they want, and your page either answers that query cleanly or hands the sale […]
Internal links are one of the most vital elements of any winning SEO strategy. However, internal linking is often one of the most underrated aspects of SEO that is often overlooked. The reason behind this is probably because most people think of internal links as simply a way to offer relevant information to their readers. […]
I’m certain that you’ve repeatedly seen the headlines “40% of websites use WordPress”, “10% of websites sit on Cloudflare”, “PHP X.X. is the most widely used software”. However, there is usually no indication of the type of websites that were analyzed nor their size. So is it really true that almost half of the Internet […]
It’s no news that Google is gradually increasing its focus on rewarding websites that deliver an outstanding user experience (UX) with better rankings. How well — and how fast — the content on your site’s various pages load lies at the core of delivering a great UX. Conventional website performance metrics like page load time […]
Data analytics plays a crucial role in SEO, especially for eCommerce businesses with a vast number of site pages. For eCommerce, a generic SEO strategy may work but will not be as impactful and profitable as a well-thought-out “divide and conquer” SEO strategy. In other words, we’re talking about a segmentation SEO strategy. With segmentation, […]
It was a fruitful, very dynamic and eventful 2020 for JetOctopus. Yes, it is not a common start when talking about 2020 as it usually starts with a “dramatically tough year… COVID… pandemic…crisis, etc. Yes, it’s all true but I want to talk about another side of 2020 for JetOctopus. It was a great adventure […]
You probably have the keywords that brought you a large amount of traffic some time ago. But, for some reason, the very same keywords might not bring you as much traffic today as they used to. One of the reasons is that the TOP-sale period for them has ended (like Black Friday, for example). The […]
The data you receive from Google Search Console allows you to see website performance in SERPs, define your weak pages, and optimize them more effectively. But GSC integration with JetOctopus allows you a lot more possibilities! You can see the dynamics of your website performance, the dynamics of impressions, clicks, positions, and CTR for specific groups […]
Search engines are not humans, and in order to understand whether the content on the page is valuable or not, they use algorithms. Pages with low textual volume and thin pages are usually considered by search engines as low-quality ones, unable to satisfy user intent. Thus, for the sake of not losing website authority in […]
Search engines are extremely strict and straight when it comes to duplications in titles and meta descriptions. And allowing them to happen on your website – is definitely missing an optimization opportunity. How to find duplicate titles: Duplicated titles are easy to find using the JetOctopus tool. Follow these steps: 1. Open Crawl – HTML […]
Slow and heavy pages make a negative effect on how users and search bots perceive your website. So having this type of pages may cost you both ranking and conversions. Read below a quick instruction on how to detect heavy pages and slow pages in several clicks and just a few seconds. At the bottom […]
Basic crawl settings: Advanced crawl settings: Updated information: How to configure a crawl of your website Basic crawl settings: 1. Project creation You can crawl a whole website or pick up a particular segment for technical analysis. If you scan your website partially, we recommend giving a clear name for each segment. The name you […]
It’s often difficult for SEOs to monitor whether experiments that you`ve tried on the website have worked out or didn’t have any positive impact on Tech SEO criteria. Here is why we suggest using the Compare Crawl option and see all the changes in dynamics by any crawl report you need: In our short video-guide, […]
Technical SEO analysis allows us to see the website`s performance and detect the main technical issues which prevent your website from high positions in SERP. And usually, tools for tech SEO audit provide SEOs with endless lists of URLs, that require additional bulky actions with Excel sheets to sort all out by issues before one […]
Get exclusive tech SEO insights
