Dec-10-2022, 01:58 PM
I'm scraping a site using Selenium but I find it slow. However, I believe it's possible to retrieve cookie information using Selenium and then proceed using Requests.
Is it possible to retrieve the cookie information once and then save it to a file so with future scraping I can omit the Selenium part and simply read in the cookie information?
If not, could I edit the cookie to determine what I need to access the site? I'm currently logging in but could omit the login if I could simply access the DB containing the information I'm downloading.
My guess is the answer is no but it's worth a shot. I know little of the web sites but Selenium seems to figure out what I need as it uses a browser.
Is it possible to retrieve the cookie information once and then save it to a file so with future scraping I can omit the Selenium part and simply read in the cookie information?
If not, could I edit the cookie to determine what I need to access the site? I'm currently logging in but could omit the login if I could simply access the DB containing the information I'm downloading.
My guess is the answer is no but it's worth a shot. I know little of the web sites but Selenium seems to figure out what I need as it uses a browser.