Oct-13-2018, 12:50 AM
FireFox may need some setup,as they messed with DesiredCapabilities, marionette ect with there driver.
Now i run with
Or:
Now i run with
geckodriver.exe
in same folder as script.Or:
browser = webdriver.Firefox(capabilities=caps, executable_path=r"path to geckodriver")Setup for headless is in Web-scraping part-2.
from selenium import webdriver from selenium.webdriver.common.keys import Keys import bs4 import time caps = webdriver.DesiredCapabilities().FIREFOX caps["marionette"] = True browser = webdriver.Firefox(capabilities=caps) browser.get('http://www.yahoo.com') assert 'Yahoo' in browser.title agree = browser.find_element_by_xpath('/html/body/div[1]/div[2]/div[4]/div/div[2]/form[1]/div/input') agree.click() elem = browser.find_element_by_name('p') # find the search box res = elem.send_keys('seleniumhq' + Keys.RETURN) #print(repr(res)) time.sleep(5) soup = bs4.BeautifulSoup(browser.page_source, "html.parser") link_a = soup.find_all('a', class_=" ac-algo fz-l ac-21th lh-24") for link in link_a: print(link.text)
Output:Selenium - Web Browser Automation
Downloads - Selenium
Selenium (software) - Wikipedia
Selenium (@SeleniumHQ) | Twitter
Selenium WebDriver - docs.seleniumhq.org
SeleniumHQ/selenium - GitHub
Selenium Projects
Selenium Sponsors
Selenium IDE
Selenium Documentation — Selenium Documentation