Python Forum
How to extract links from grid located on webpage
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How to extract links from grid located on webpage
#1
Hello,

How to extract links from this url:
Une sélection de concerts électroniques et électrisants

I tried different tags (using selenium) ... nothing works.
Thanks in advance.

from selenium import webdriver
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.common.by import By

url = 'https://www.arte.tv/fr/videos/RC-019798/electro-chillout/'
pattern = '.css-zqu0w1'
pattern_class = 'css-1tqpy7w'
pattern_class = 'css-1wbmdb2'
pattern_css = 'div.css-1tqpy7w:nth-child(1) > a:nth-child(1)'
pattern_class1 = 'css-1wbmdb2 [herf]'
#div.css-1tqpy7w:nth-child(2) > a:nth-child(1)
pattern_id = 'teaserItemLink'

options = Options()
options.add_argument("--headless")

driver = webdriver.Chrome(options=options)
driver.get(url)
grid = driver.find_elements(By.CLASS_NAME, pattern_class)
for item in grid:
    print(item.text)

aaa = driver.find_elements(By.CLASS_NAME, pattern_class1)
print(aaa)

bbb = driver.find_elements(By.ID, pattern_id)
print(bbb)
Reply


Messages In This Thread
How to extract links from grid located on webpage - by Pavel_47 - Dec-23-2022, 07:06 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  extract javascript links Larz60+ 0 1,888 Feb-16-2022, 10:49 AM
Last Post: Larz60+
  getting links from webpage and store it into an array apollo 1 2,717 May-22-2021, 03:35 PM
Last Post: perfringo
  Want to extract 4 tables from webpage - Nubee Stuck :( andrewjmdata1 0 1,813 Apr-19-2020, 05:42 PM
Last Post: andrewjmdata1
  Extract data from a webpage cycloneseb 5 3,019 Apr-04-2020, 10:17 AM
Last Post: alekson
  webscrapping links and then enter those links to scrape data kirito85 2 3,378 Jun-13-2019, 02:23 AM
Last Post: kirito85

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020