Python Forum
Web Scraping Inquiry (Extracting content from a table in asubdomain)
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Web Scraping Inquiry (Extracting content from a table in asubdomain)
#1
Good Day,

I am very new to Python and am just now learning Beautiful Soup and web scraping methods. I wanted to try to practice one method by automating a very tedious process whereas the script does the following:

1. Goes to this link: https://mattrode.com/blog/robinhood-collections-list/

2. Goes to each of the sublinks (numbered 1 to 191) (Example https://robinhood.com/collections/100-most-popular)

3. In that link extracts the symbol and saves it to a .csv (or text) file.

and it does it for every one of the links and symbols within each link.

I have searched online for doing this but I'm really not sure where to start or what to look for exactly.

Two things I do not yet know how to do: 1. Navigate to subdomains and return back to the original link to go into the next one and 2. extract elements from a table as complex as the ones in the link provided.

If anyone could assist me with this I would be grateful.
Reply


Messages In This Thread
Web Scraping Inquiry (Extracting content from a table in asubdomain) - by DustinKlent - Aug-16-2020, 08:55 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Help Scraping links and table from link cartonics 11 1,602 Oct-12-2023, 06:42 AM
Last Post: cartonics
  Scraping data from table into existing dataframe vincer58 1 2,023 Jan-09-2022, 05:15 PM
Last Post: vincer58
  Scraping the page without distorting content oleglpts 5 2,500 Dec-16-2021, 05:08 PM
Last Post: oleglpts
  Python Web Scraping can not getting all HTML content yqqwe123 0 1,647 Aug-02-2021, 08:56 AM
Last Post: yqqwe123
  Need help scraping wikipedia table bborusz2 6 3,266 Dec-01-2020, 11:31 PM
Last Post: snippsat
  Scraping a dynamic data-table in python through AJAX request filozofo 1 3,893 Aug-14-2020, 10:13 AM
Last Post: kashcode
  scraping multiple pages from table bandar 1 2,707 Jun-27-2020, 10:43 PM
Last Post: Larz60+
  BeautifulSoup: Error while extracting a value from an HTML table kawasso 3 3,234 Aug-25-2019, 01:13 AM
Last Post: kawasso
  Web scraping User Generated Content StephenG93 2 2,958 Oct-10-2018, 12:17 AM
Last Post: StephenG93
  Web scraping "fancy" table acehole60 2 4,918 Dec-16-2016, 09:17 AM
Last Post: acehole60

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020