Python Forum
Problem with searching over Beautiful Soap object
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Problem with searching over Beautiful Soap object
#9
(May-27-2022, 10:42 AM)snippsat Wrote: If set User Agent with Requests(and use with Bs) i did work 1-2 times then Amazon lock it out.
Quote:To discuss automated access to Amazon data please contact [email protected].

Thanks. I'll try.
By suggesting to use selenium, do you mean that BeautifulSoup is not capable of handling such tasks?
Please note that I actually have no problem with Amazon lock.
Every time I make a request on the Amazon site, I check the return status code.
When it works, this code is 200.
In my experience, to get locked you have to make about 60...100 requests from the same IP.
The lock is held for about 2 hours, then it releases.
Reply


Messages In This Thread
RE: Problem with searching over Beautiful Soap object - by Pavel_47 - May-27-2022, 11:13 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Beautifull Soap. Split page using a value and not a tag. lillo123 5 3,559 Apr-21-2021, 09:11 AM
Last Post: lillo123
  Beautiful Soap can't find a specific section on the page Pavel_47 1 2,502 Jan-18-2021, 02:18 PM
Last Post: snippsat
  Beautiful soup and tags starter_student 11 6,468 Jul-08-2019, 03:41 PM
Last Post: starter_student
  Beautiful Soup find_all() kirito85 2 3,480 Jun-14-2019, 02:17 AM
Last Post: kirito85
  form.populate_obj problem "object has no attribute translate" pascale 0 3,732 Jun-12-2019, 07:30 PM
Last Post: pascale
  Need help with Beautiful Soup - table jlkmb 9 6,133 Dec-20-2018, 01:10 AM
Last Post: jlkmb
  Type Not Found error on python soap call using suds library wellborn 1 4,696 Dec-19-2017, 07:53 PM
Last Post: micseydel
  Help with beautiful soup Larz60+ 5 4,573 Jul-18-2017, 08:19 PM
Last Post: Larz60+

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020