Scrapping javascript website with Selenium where pages randomly fail to load - Printable Version +- Python Forum (https://python-forum.io) +-- Forum: Python Coding (https://python-forum.io/forum-7.html) +--- Forum: Web Scraping & Web Development (https://python-forum.io/forum-13.html) +--- Thread: Scrapping javascript website with Selenium where pages randomly fail to load (/thread-23367.html) Pages:
1
2
|
RE: Scrapping javascript website with Selenium where pages randomly fail to load - JuanJuan - Dec-26-2019 Yes and if you try in different browser that page might load. This page https://www.sazka.cz/kurzove-sazky/fotbal/anglie-3-liga/ loads everytime but when i use this one then source does not contain data loaded via javascript. But that webpage you tried to load exist and works. I tried now and url you tried to load loaded in Opera but not in Chrome or Firefox. Other url i provided loaded in Firefox and Chrome but not in Opera. I just tested it now. I can even provide a screenshot of that webpage to prove that it does exist. RE: Scrapping javascript website with Selenium where pages randomly fail to load - Larz60+ - Dec-27-2019 This just doesn't make any sense. Do you actually see the html data loaded? RE: Scrapping javascript website with Selenium where pages randomly fail to load - JuanJuan - Dec-27-2019 Yes, i could see a html data and inspect them. And data were actual not loaded from some old cookies because those betting odds were changing as they were updated. This is why i am so confused. Both your and mine code works but this random 404 error confuse me. As i said before some urls i try to scrape load everytime and others randomly fail to load in one browser but loads correctly at the same time in another. I do not see any logic behind this too. RE: Scrapping javascript website with Selenium where pages randomly fail to load - Larz60+ - Dec-27-2019 Then I can't explain. Perhaps someone else will. Good luck! RE: Scrapping javascript website with Selenium where pages randomly fail to load - JuanJuan - Dec-27-2019 Thank you for your time. I appreciate it. |