Error with crawling site.

Thread Rating:

Thread Modes

Error with crawling site.

wavic
So-and-so of the Yard

Posts: 2,955

Threads: 48

Joined: Sep 2016

Reputation: 90

Oct-10-2017, 06:36 PM

You are sending requests as fast as the system can. Put some random delay between these requests. Some servers don't respect bots.

"As they say in Mexico 'dosvidaniya'. That makes two vidaniyas."
https://freedns.afraid.org

Messages In This Thread

RE: Error with crawling site. - by wavic - Oct-10-2017, 06:36 PM

Possibly Related Threads…
Thread		Author	Replies	Views	Last Post
	need help with crawling FB likes	najla3	2	2,712	Jan-09-2018, 11:15 AM Last Post: najla3

Users browsing this thread: 1 Guest(s)