Python Forum

Full Version: scraping a table from an http page
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
A website that I have to log into and work my way through to a page with selenium is okay.

The problem I have is getting the one table that is showing on that page.
The page is only http and had to bypass the SSL cert verification.
Using requests with verify=False and curentulr

I have decided to save the full page to a text format, as I just cannot drag out that one table.
On opening the saved xml file, the page that has been saved is that of the initial log in page.

I have tried pandas but get a lot of errors when using read_html so do not get a dataframe to look at and do not know where to turn next.

What am I doing wrong? Can someone help
Is the table part of the page, or does it get generated when a particular event is triggered?
Can you share the URL, and provide enough information so table can be located?
This would be quite helpful.

EDIT
I missed the SSL part, so I'm guessing we won't be able to access