There are severals big problems here.
Should not be needed now to say that you should be using Python 2.7,it has been dead💀 for 3-years now.
For the scraing part the url leads to a login page and not the main page,so copy content will only copy the login page.
So this is far away from working,to give some hint i would use Selenuim to do login to get to main page.
It depends what main page data has available without requesting something.
Should not be needed now to say that you should be using Python 2.7,it has been dead💀 for 3-years now.
For the scraing part the url leads to a login page and not the main page,so copy content will only copy the login page.
So this is far away from working,to give some hint i would use Selenuim to do login to get to main page.
from selenium import webdriver from selenium.webdriver.chrome.options import Options from selenium.webdriver.chrome.service import Service from selenium.webdriver.common.by import By from selenium.webdriver.support.ui import WebDriverWait from bs4 import BeautifulSoup import time #--| Setup options = Options() #options.add_argument("--headless") ser = Service(r"C:\cmder\bin\chromedriver.exe") browser = webdriver.Chrome(service=ser, options=options) #--| Parse or automation url = 'https://edd.telstra.com/telstra/' browser.get(url) browser.implicitly_wait(2) user_name = browser.find_element(By.CSS_SELECTOR, '#Username') user_name.send_keys('login_name') bus_id = browser.find_element(By.CSS_SELECTOR, '#Business\ ID') bus_id.send_keys('999')So start like this then push
login
button to get to main page,then copy content may work or not at all.It depends what main page data has available without requesting something.