Python Forum
Can't figure out how to scrape grid
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Can't figure out how to scrape grid
#4
I don't see a single div with class 'media' in the source.

If you just choose one sub-page, say the first with title that starts with "CMS Could Strengthen Program"
you will note the surrounding html has

  1. Section starts with div:
    <div class="USA-card__container">
  2. followed by a header, an h2 header, and a link

This pattern repeats for each report on the page,
thus:

1. find all divs with class="USA-card__container"
2. then get the link div.header.h2.a
3. get the page for download page from the 'href' tag.
4. wait for page to load
5. locate the PDF and download

I do not see any csv files.
Reply


Messages In This Thread
Can't figure out how to scrape grid - by templeowls - Jun-13-2024, 05:14 PM
RE: Can't figure out how to scrape grid - by Larz60+ - Jun-19-2024, 05:45 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  scrape data 1 go to next page scrape data 2 and so on alkaline3 6 5,603 Mar-13-2020, 07:59 PM
Last Post: alkaline3

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020