Apr-24-2019, 07:06 PM
Quote:I've tried this in the past using requests and or selenium, as I recall requests was good a filling in the forms and selenium was okay and mimicking a browser but I haven't found a good tool to do both and I don't believe I can make them share a connection variable/object.
I use a combination all the time. Just posted a simple example that uses Selenium to expand javascript, then beautifulsoup to parse. Although I don't do it in this simple script, there's no reason that you can't use selenium to click , fill in search boxes (and/or password info), and on target page extract links and get those pages using beautifulsoup and requests: https://python-forum.io/Thread-get-hotel...7#pid78167