Python Forum
No data when using scrapy to get data
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
No data when using scrapy to get data
#2
Looks like the data is loaded from an API using javascript.
The easiest way to get it yourself would be requesting it from the API directly, which will give you the data as json.

The API url is https://www.sydneyairport.com.au/_a/flights<query_parameters>
Reply


Messages In This Thread
No data when using scrapy to get data - by ADBYITMS - Nov-11-2019, 03:10 AM
RE: No data when using scrapy to get data - by stranac - Nov-11-2019, 06:57 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Scrapy does not show all data in iteration loop georgekasa 0 2,026 Jul-31-2021, 09:10 AM
Last Post: georgekasa
  How to crawl schema markup data type using scrapy? Nuwan16 1 3,123 Mar-31-2020, 03:42 PM
Last Post: stranac
  scrape data 1 go to next page scrape data 2 and so on alkaline3 6 5,316 Mar-13-2020, 07:59 PM
Last Post: alkaline3
  Scrapy-cut: Advanced Cookiecutter Scrapy Templating scriptso 2 4,710 Feb-02-2017, 07:57 PM
Last Post: scriptso

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020