Python Forum
Scrapping javascript website with Selenium where pages randomly fail to load - Printable Version

+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: Web Scraping & Web Development (https://python-forum.io/forum-13.html)
+--- Thread: Scrapping javascript website with Selenium where pages randomly fail to load (/thread-23367.html)

Pages: 1 2


RE: Scrapping javascript website with Selenium where pages randomly fail to load - JuanJuan - Dec-26-2019

Yes and if you try in different browser that page might load. This page https://www.sazka.cz/kurzove-sazky/fotbal/anglie-3-liga/ loads everytime but when i use this one then source does not contain data loaded via javascript. But that webpage you tried to load exist and works. I tried now and url you tried to load loaded in Opera but not in Chrome or Firefox. Other url i provided loaded in Firefox and Chrome but not in Opera. I just tested it now. I can even provide a screenshot of that webpage to prove that it does exist. [Image: BBAR40Q]


RE: Scrapping javascript website with Selenium where pages randomly fail to load - Larz60+ - Dec-27-2019

This just doesn't make any sense.
Do you actually see the html data loaded?


RE: Scrapping javascript website with Selenium where pages randomly fail to load - JuanJuan - Dec-27-2019

Yes, i could see a html data and inspect them. And data were actual not loaded from some old cookies because those betting odds were changing as they were updated. This is why i am so confused. Both your and mine code works but this random 404 error confuse me. As i said before some urls i try to scrape load everytime and others randomly fail to load in one browser but loads correctly at the same time in another. I do not see any logic behind this too.


RE: Scrapping javascript website with Selenium where pages randomly fail to load - Larz60+ - Dec-27-2019

Then I can't explain. Perhaps someone else will. Good luck!


RE: Scrapping javascript website with Selenium where pages randomly fail to load - JuanJuan - Dec-27-2019

Thank you for your time. I appreciate it.