Python Forum
Scrapping javascript website with Selenium where pages randomly fail to load
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Scrapping javascript website with Selenium where pages randomly fail to load
#11
Yes and if you try in different browser that page might load. This page https://www.sazka.cz/kurzove-sazky/fotba...ie-3-liga/ loads everytime but when i use this one then source does not contain data loaded via javascript. But that webpage you tried to load exist and works. I tried now and url you tried to load loaded in Opera but not in Chrome or Firefox. Other url i provided loaded in Firefox and Chrome but not in Opera. I just tested it now. I can even provide a screenshot of that webpage to prove that it does exist. [Image: BBAR40Q]
Reply
#12
This just doesn't make any sense.
Do you actually see the html data loaded?
Reply
#13
Yes, i could see a html data and inspect them. And data were actual not loaded from some old cookies because those betting odds were changing as they were updated. This is why i am so confused. Both your and mine code works but this random 404 error confuse me. As i said before some urls i try to scrape load everytime and others randomly fail to load in one browser but loads correctly at the same time in another. I do not see any logic behind this too.
Reply
#14
Then I can't explain. Perhaps someone else will. Good luck!
Reply
#15
Thank you for your time. I appreciate it.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Problem with scrapping Website giddyhead 1 1,580 Mar-08-2024, 08:20 AM
Last Post: AhanaSharma
  python web scrapping mg24 1 270 Mar-01-2024, 09:48 PM
Last Post: snippsat
  Scaping pages created by javascript mbizzl 1 1,481 Jul-17-2022, 10:01 PM
Last Post: Larz60+
  How can I ignore empty fields when scrapping never5000 0 1,354 Feb-11-2022, 09:19 AM
Last Post: never5000
  Suggestion request for scrapping html table Vkkindia 3 1,987 Dec-06-2021, 06:09 PM
Last Post: Larz60+
  web scrapping through Python Naheed 2 2,576 May-17-2021, 12:02 PM
Last Post: Naheed
  Website scrapping and download santoshrane 3 4,257 Apr-14-2021, 07:22 AM
Last Post: kashcode
  Using Python request without selenium on html form with javascript onclick submit but eraosa 0 3,135 Jan-09-2021, 06:08 PM
Last Post: eraosa
  Newbie help with lxml scrapping chelsealoa 1 1,827 Jan-08-2021, 09:14 AM
Last Post: Larz60+
  Scrapping Sport score laplacea 1 2,221 Dec-13-2020, 04:09 PM
Last Post: Larz60+

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020