Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Web Scraping with a Bot
#9
I think they know that you are using proxy server and that is suspicious at first.
I would use Selenium, slow down the the requests per second by a random value and hope they will respect that I don't want to rape their server. I can't think for something else. I am not networking guy.
"As they say in Mexico 'dosvidaniya'. That makes two vidaniyas."
https://freedns.afraid.org
Reply


Messages In This Thread
Web Scraping with a Bot - by HiImNew - May-06-2018, 06:35 AM
RE: Web Scraping with a Bot - by wavic - May-06-2018, 03:22 PM
RE: Web Scraping with a Bot - by HiImNew - May-06-2018, 03:55 PM
RE: Web Scraping with a Bot - by wavic - May-06-2018, 05:49 PM
RE: Web Scraping with a Bot - by HiImNew - May-06-2018, 07:09 PM
RE: Web Scraping with a Bot - by digitalmatic7 - May-07-2018, 03:14 AM
RE: Web Scraping with a Bot - by wavic - May-07-2018, 05:28 AM
RE: Web Scraping with a Bot - by HiImNew - May-07-2018, 05:46 PM
RE: Web Scraping with a Bot - by wavic - May-07-2018, 06:18 PM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020