Python Forum
Extracting all the links on a website
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Extracting all the links on a website
#2
Maybe replace line 19 with this:
link = urllib.parse.urljoin(str(url), str(link))
That's where the problem hits, but that may not be where it starts. If that doesn't work you will need to print the url and the link to see what's going in and breaking it.
Reply


Messages In This Thread
RE: Extracting all the links on a website - by Clunk_Head - Jan-09-2020, 04:47 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  All product links to products on a website MarionStorm 0 1,089 Jun-02-2022, 11:17 PM
Last Post: MarionStorm
  Extracting links from website with selenium bs4 and python M1ck0 1 3,754 Jul-20-2019, 10:29 PM
Last Post: Larz60+
  webscrapping links and then enter those links to scrape data kirito85 2 3,224 Jun-13-2019, 02:23 AM
Last Post: kirito85
  Download all secret links from a map design website fyec 0 2,855 Jul-24-2018, 09:08 PM
Last Post: fyec

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020