I'd like to download all posts from a support site. Can I process the "I am not a spammer" button using requests?
The site has a search feature but I'd like to peruse the posts offline.
(Jan-18-2022, 05:09 PM)rhubarbpieguy Wrote: [ -> ]I'd like to download all posts from a support site. Can I process the "I am not a spammer" button using requests?
It is not straightforward to click on buttons using Requests,
need to look what send in network request(Dev tools) and also JavaScript code that trigger the button.
Then try to recreate the Get/Post requests that is send to HTTP endpoint.
Selenium is much more strait forward for this as you find name or eg the CSS selector of button,
then use the
.click() method.