Product Update. Verifying Googlebot with JetOctopus

We are happy to announce a new release from the JetOctopus team. From now on, you can verify Googlebot using our service. This tool is very useful for all websites, because in this way you will be able to detect spam crawlers and troublemaking web scrappers that emulate Googlebot.

How JetOctopus verifies Googlebot

For Googlebot verification, we use IP address matching and reverse DNS lookup.

Now you can not only look at the list of user agents visiting your website, but also check every suspicious visit. After all, many troublemaking crawlers disguise themselves as Googlebot, using the same data in the user-agent string as Googlebot. However, Googlebot uses special IP addresses that are not available to other user agents.

To verify the Googlebot, go to the “Tools” menu, then select “Validate Googlebot IP”.

Next, enter the IP address and click “Validate”. If it is Googlebot IP, you will receive a detailed notification about it.

Also, JetOctopus will show if the IP is not used by Googlebot.

Note that the IP must not be a subnet mask, i.e. you can validate IP 34.101.50.144 but not 34.101.50.144/28.

The main advantage of this tool is the possibility of full control over the user agents that are visiting your website. You will be able to block IP addresses that load or attack your web server immediately after detection.

You may be interested in: How to analyze what types of GoogleBots are visiting your website and why it matters

How to analyze the URLs most and least visited by GoogleBot

The service is absolutely free for all our customers.

By the way, when analyzing logs, JetOctopus automatically validates all IP addresses of user agents using “Googlebot” in user agent string, so you can be sure that the “Logs” section in the “Googlebot” menu displays data only for this search engine without fake bots.

Read also: How to find out the frequency of scanning by search robots

Why is not all the traffic of search robots displayed in the logs?