Python Forum
How to extract links from grid located on webpage
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How to extract links from grid located on webpage
#6
It seems that you are trying to extract links from the given URL using Selenium and the Chrome WebDriver. However, there are some issues in the way you are trying to locate the elements.

Use By.CSS_SELECTOR to locate the elements by the CSS selector. The class 'css-1wbmdb2' seems to be the correct class that contains the links.Then find all anchor elements (links) within this class and extract their 'href' attribute to get the URLs.

Here is have updated your code:-

from selenium import webdriver
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.common.by import By

url = 'https://www.arte.tv/fr/videos/RC-019798/electro-chillout/'

options = Options()
options.add_argument("--headless")

driver = webdriver.Chrome(options=options)
driver.get(url)

# Find all anchor elements within the specific class 'css-1wbmdb2'
links = driver.find_elements(By.CSS_SELECTOR, '.css-1wbmdb2 a')

# Extract and print the href attribute of each link
for link in links:
    href = link.get_attribute('href')
    print(href)

driver.quit()
Reply


Messages In This Thread
RE: How to extract links from grid located on webpage - by Gaurav_Kumar - Aug-04-2023, 12:43 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  extract javascript links Larz60+ 0 1,888 Feb-16-2022, 10:49 AM
Last Post: Larz60+
  getting links from webpage and store it into an array apollo 1 2,717 May-22-2021, 03:35 PM
Last Post: perfringo
  Want to extract 4 tables from webpage - Nubee Stuck :( andrewjmdata1 0 1,813 Apr-19-2020, 05:42 PM
Last Post: andrewjmdata1
  Extract data from a webpage cycloneseb 5 3,020 Apr-04-2020, 10:17 AM
Last Post: alekson
  webscrapping links and then enter those links to scrape data kirito85 2 3,378 Jun-13-2019, 02:23 AM
Last Post: kirito85

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020