Python Forum
scraping a table from an http page
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
scraping a table from an http page
#1
A website that I have to log into and work my way through to a page with selenium is okay.

The problem I have is getting the one table that is showing on that page.
The page is only http and had to bypass the SSL cert verification.
Using requests with verify=False and curentulr

I have decided to save the full page to a text format, as I just cannot drag out that one table.
On opening the saved xml file, the page that has been saved is that of the initial log in page.

I have tried pandas but get a lot of errors when using read_html so do not get a dataframe to look at and do not know where to turn next.

What am I doing wrong? Can someone help
Reply
#2
Is the table part of the page, or does it get generated when a particular event is triggered?
Can you share the URL, and provide enough information so table can be located?
This would be quite helpful.

EDIT
I missed the SSL part, so I'm guessing we won't be able to access
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Python SSL web page scraping Vadanane 1 874 Jan-13-2023, 04:11 PM
Last Post: snippsat
  Problem with scraping the Title from a web page Wagner822 0 667 Jun-29-2022, 11:31 PM
Last Post: Wagner822
Brick Javascript based web page scraping amjadraza26 1 1,427 Oct-21-2021, 09:36 AM
Last Post: Larz60+
  ModuleNotFoundError: No module named 'http.client'; 'http' is not a package abhishek81py 1 15,254 Jun-25-2020, 08:58 AM
Last Post: buran

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020