Yandex doesn't index Wix sites


Jun 6, 2018
  • Please, share!

Yandex doesn't index Wix sites

Is it temporary or is it time to start worrying and switch to something else?

The news that Yandex stopped indexing the websites created at wix.com. was first featured on June 5th. Worried webmasters started discussing the situation saying that websites builders are better not used at all anymore.

The team of jetoctopus.com web-crawler decided to study the problem and see whether all Wix websites are really not indexed by Yandex.
To do that for 24 hours we had crawled all the known .ru domains – that’s 5.62 mln and selected only the working Wix ones – 21.959.
From that figure we took about a half – 10 thousand domains – and checked their indexation:


As you see only 11% of Wix sites index pages are indexed by Yandex, it is just the other way round with Google.

According to Mikhail Slivinsky, the head of the Yandex webmaster service, the problem is caused by Yandex and is to be solved shortly.

Mikhail Slivinsky: “– Some sites using ajax may have faced some difficulties with Yandex-bot lately. At the moment we’re busy testing some changes at our end. Within a couple of days the situation will be improved”.

For the last year it’s been said a lot about SE indexation support of Javascript websites. But in reality the situation is reverse. There do arise frequent difficulties with such websites, as Google uses the old Chrome 41 version for rendering. Almost any javascript error that wasn’t found in time may result in the crawler’s incorrect work and make the page non-indexable in the end. In case the site was created with the help of a builder like Wix the only things a webmaster can do are:

  • to hope the problem will be solved soon on either the search system or the constructor side;
  • to switch to another CMS.

This situation shows that it is very important to keep a strict eye on your site technical condition, no matter what technologies it is based on - surprises may come any time.

Read more: How we scanned the Internet and what we’ve found.

ABOUT THE AUTHOR

Serge Bezborodov is a CTO of JetOctopus. He is a professional programmer with 9+ years of experience. He has worked with aggregators for 5 years - vacancies, real estate, cars. Also, he has experience in design DB architecture and query optimization. Serge has crawled more than 160 mln pages, 40 TB of data with JetOctopus.

  • Please, share!
auto.ria.com
Auto classified, 20m pages crawled
Duplications
What problem was your SEO department working at when you decided to try our crawler?
We needed to detect all possible errors in no time because Google Search Console shows only 1000 results per day.

What problems did you find
That’s quite a broad question. We managed to detect old, unsupported pages and errors related to them. We also found a large number of duplicated pages and pages with 404 response code.

How quickly did you implement the required changes after the crawl?
We are still implementing them because the website is large and there are lots of errors on it. There are currently 4 teams working on the website. In view of this fact we have to assign each particular error to each particular team and draw up individual statements of work.

And what were they?
It’s quite difficult to measure results right now because we constantly work on the website and make changes. But a higher scan frequency by bots would mean the changes are productive. However, around one and a half months ago we enabled to index all the paginated pages and this has already affected our statistics.

Having seen the crawl report, what was the most surprising thing you found? (Were there errors you’d never thought you’d find?)
I was surprised to find so many old, unsupported pages which are out of the website’s structure. There were also a large number of 404 pages. We are really glad we’ve managed to get a breakdown of the website subdirectories. Thus we’ve made a decision which team we will start working with in the beginning.

You have worked with different crawlers. Can you compare JetOctopus with the others and assess it?
Every crawler looks for errors and finds them. The main point is the balance between the scanned pages and the price. JetOctopus is one of the most affordable crawlers.

Would you recommend JetOctopus to your friends?
We’re going to use it within our company from time to time. I would recommend the crawler to my friends if they were SEO optimizers.

Your suggestions for JetOctopus.
To refine the web version ASAP. There are a few things we were missing badly:
Thank you very much for such a detailed analysis. Currently we have been reflecting on a redirects' problem.
ultra.by
Do you wan’t
more SEO traffic?
All sites have technical errors which block your SEO traffic boost
I’ts an axiom
Find out the most epic errors ot your site and start fixing them
The amount of the provided information is quite enough and you can see at once where and what the problems are
auto.ria.com