We make full website crawling to find main technical errors at a website.
Also crawling report gives the answers to the problems found in logs.
Why these particular pages are not visited by bots?
If DFI is ok, or if all the indexation parameters are correct etc.
The speed of crawling is up to 200 pages per sec. The fastest on the