Python Forum
Python Forum

Search Results
Post Author Forum Replies Views Posted [asc]
    Thread: Scrapping javascript website with Selenium where pages randomly fail to load
Post: RE: Scrapping javascript website with Selenium whe...
Thank you for your time. I appreciate it.
 JuanJuan Web Scraping & Web Development 14 7,260 Dec-27-2019, 12:32 PM
    Thread: Scrapping javascript website with Selenium where pages randomly fail to load
Post: RE: Scrapping javascript website with Selenium whe...
Yes, i could see a html data and inspect them. And data were actual not loaded from some old cookies because those betting odds were changing as they were updated. This is why i am so confused. Both y...
 JuanJuan Web Scraping & Web Development 14 7,260 Dec-27-2019, 12:17 PM
    Thread: Scrapping javascript website with Selenium where pages randomly fail to load
Post: RE: Scrapping javascript website with Selenium whe...
Yes and if you try in different browser that page might load. This page https://www.sazka.cz/kurzove-sazky/fotba...ie-3-liga/ loads everytime but when i use this one then source does not contain data ...
 JuanJuan Web Scraping & Web Development 14 7,260 Dec-26-2019, 10:48 PM
    Thread: Scrapping javascript website with Selenium where pages randomly fail to load
Post: RE: Scrapping javascript website with Selenium whe...
Webpages do exist, that is why i wrote i checked in another browser. I get 404 error even tho that page loads at that same moment in another browser. I understand few of provided urls are indeed not a...
 JuanJuan Web Scraping & Web Development 14 7,260 Dec-26-2019, 10:13 PM
    Thread: Scrapping javascript website with Selenium where pages randomly fail to load
Post: RE: Scrapping javascript website with Selenium whe...
So it seems that same problem occur with your code too :( . i had to add encoding="utf-8 into savefile and after that code ran as it should. Still randomly some pages did not load and i checked that t...
 JuanJuan Web Scraping & Web Development 14 7,260 Dec-26-2019, 09:42 PM
    Thread: Scrapping javascript website with Selenium where pages randomly fail to load
Post: RE: Scrapping javascript website with Selenium whe...
Thank you i will look into it. I am aware that many links now are not available due to winter break in soccer leagues but certain leagues retry 404 error even if they are available.
 JuanJuan Web Scraping & Web Development 14 7,260 Dec-26-2019, 11:24 AM
    Thread: Scrapping javascript website with Selenium where pages randomly fail to load
Post: RE: Scrapping javascript website with Selenium whe...
from bs4 import BeautifulSoup from pprint import pprint import requests import csv import re import time import random from selenium import webdriver from selenium.webdriver.common.action_chains impor...
 JuanJuan Web Scraping & Web Development 14 7,260 Dec-25-2019, 07:21 PM
    Thread: Scrapping javascript website with Selenium where pages randomly fail to load
Post: Scrapping javascript website with Selenium where p...
I have a python scrapper with selenium for scrapping a dynamically loaded javascript website. Scrapper by itself works ok but pages sometimes fail to load with 404 error. Problem is that public http d...
 JuanJuan Web Scraping & Web Development 14 7,260 Dec-25-2019, 01:35 PM

User Panel Messages

Log Out
My Profile
Pay your profile a visit
User Control Panel
Do some changes on your profile
My Messages
View private messages unread
Avatar
Change avatar
Signature
Change signature
Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020