Python Forum
trying to save data automatically from this page
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
trying to save data automatically from this page
#1
Hello everyone,
I hope you are all well.

I'm trying to automatically save data from this graphical presentation in this link:

https://weather.com/weather/radar/intera...382f593cc4

and this one:

https://midcdmz.nrel.gov/apps/gdisplay.pl?UAT


I want to do this through python. I tried using : tables_list = pd.io.html.read_html(url)
but with no luck.

What is the right way to do it ?
Thanks a lot
Reply
#2
NREL at the very least has an API (at the bottom of https://midcdmz.nrel.gov/, there's a link titled "Developers") and you should look for one for the weather site. Essentially, an API allows you to make HTTP requests, returning data in a way that's easy for the machine to parse (e.g. JSON).
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Save JSON data to sqlite database on Django Quin 0 2,804 Mar-26-2022, 06:22 PM
Last Post: Quin
  Scraping a page with log in data (security, proxies) iamaghost 0 2,103 Mar-27-2021, 02:56 PM
Last Post: iamaghost
  use Xpath in Python :: libxml2 for a page-to-page skip-setting apollo 2 3,583 Mar-19-2020, 06:13 PM
Last Post: apollo
  Sending data to php page ebolisa 0 1,889 Mar-18-2020, 05:34 PM
Last Post: ebolisa
  scrape data 1 go to next page scrape data 2 and so on alkaline3 6 5,091 Mar-13-2020, 07:59 PM
Last Post: alkaline3
  how to save the data from MySQL to CSV in Flask farah97 4 2,899 Jan-03-2020, 03:02 AM
Last Post: farah97
  Scrap data from not standarized page? zarize 4 3,245 Nov-25-2019, 10:25 AM
Last Post: zarize
  Selenium get data from newly accessed page hoff1022 2 2,904 Oct-09-2019, 06:52 PM
Last Post: hoff1022
  Scraping data from ebay seller page yuvalta 3 5,948 Sep-25-2019, 04:22 AM
Last Post: sandramoraes
  how retrieve database save multiple data in web Django 2.1 taomihiranga 0 2,764 Jul-30-2019, 04:58 PM
Last Post: taomihiranga

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020