Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
url web scraping
#1
Hello,

I was wondering if it is possible to web scrape urls that you get from web scraping the original url? So the original url has 15 different urls/links that lead to different sites, and the 15 urls have the exact same format for their web page, but the data I want to retrieve from the 15 different urls are different. So is it possible to make an algoritm or function of some sort that retrieves the 15 urls from the original url and then web scrapes those 15 urls in the same way, since the format of the web pages in the 15 different urls are the exact same, they just contain different data?

Hope you guys understand my question, any advice would be greatly appriciated!

Thanks!
Reply
#2
Sure, no problem. You can scrape the links from a page and then in turn access those links.
Reply


Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020