Category: How to guides
May 27, 2020
by Ann
Logs files register each request the web server receives. If you want to get SEO insights from logs, you'll need to deal with heavy-data processing. That can only be done by...
May 27, 2020
by Ann
When search bot crawls your website and finds similar data on multiple URLs, it doesn’t know how to treat your content. In most cases, bot trusts the clues you give it (unless...
May 27, 2020
by Ann
Yes, Robots.txt can be ignored by bots and yes, it's not secure: everyone could see the content of this file. Nevertheless, well-considered robots.txt helps to deliver your...
