Python Forum
Scrap data from not standarized page?
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Scrap data from not standarized page?
#2
(Nov-20-2019, 02:27 PM)zarize Wrote: [ ... ]
I cannot use specific div or other html-type because every table is named the same (with only different font).

I just don't know how to tell python look for "SUMMARY COMPENSATION TABLE" and get whole data from table below.

Hi!

I think you could look for "SUMMARY COMPENSATION TABLE" and then, calculating the biggest table, or something you know the table always ends with, to use it like the end of the copy/get file process. This could be like 40 lines after "SUMMARY COMPENSATION TABLE" (if the tables are usually that high or less).

Here you may have some ideas:
https://python-forum.io/Thread-print-a-w...ord-search

All the best,
newbieAuggie2019

"That's been one of my mantras - focus and simplicity. Simple can be harder than complex: You have to work hard to get your thinking clean to make it simple. But it's worth it in the end because once you get there, you can move mountains."
Steve Jobs
Reply


Messages In This Thread
Scrap data from not standarized page? - by zarize - Nov-20-2019, 02:27 PM
RE: Scrap data from not standarized page? - by newbieAuggie2019 - Nov-20-2019, 02:51 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Web scrap --Need help Lizardpython 4 1,039 Oct-01-2023, 11:37 AM
Last Post: Lizardpython
  trying to save data automatically from this page thunderspeed 1 2,026 Sep-19-2021, 04:57 AM
Last Post: ndc85430
  Scraping a page with log in data (security, proxies) iamaghost 0 2,157 Mar-27-2021, 02:56 PM
Last Post: iamaghost
  I tried every way to scrap morningstar financials data without success so far sparkt 2 8,280 Oct-20-2020, 05:43 PM
Last Post: sparkt
  Web scrap multiple pages anilacem_302 3 3,863 Jul-01-2020, 07:50 PM
Last Post: mlieqo
  Need logic on how to scrap 100K URLs goodmind 2 2,644 Jun-29-2020, 09:53 AM
Last Post: goodmind
  use Xpath in Python :: libxml2 for a page-to-page skip-setting apollo 2 3,652 Mar-19-2020, 06:13 PM
Last Post: apollo
  Sending data to php page ebolisa 0 1,918 Mar-18-2020, 05:34 PM
Last Post: ebolisa
  scrape data 1 go to next page scrape data 2 and so on alkaline3 6 5,214 Mar-13-2020, 07:59 PM
Last Post: alkaline3
  Scrap a dynamic span hefaz 0 2,708 Mar-07-2020, 02:56 PM
Last Post: hefaz

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020