Python Forum
No data when using scrapy to get data
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
No data when using scrapy to get data
#3
(Nov-11-2019, 06:57 AM)stranac Wrote: Looks like the data is loaded from an API using javascript. The easiest way to get it yourself would be requesting it from the API directly, which will give you the data as json. The API url is https://www.sydneyairport.com.au/_a/flights


Ok great so how would i change my code to do this , still really new at this
Reply


Messages In This Thread
No data when using scrapy to get data - by ADBYITMS - Nov-11-2019, 03:10 AM
RE: No data when using scrapy to get data - by ADBYITMS - Nov-11-2019, 07:14 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Scrapy does not show all data in iteration loop georgekasa 0 2,025 Jul-31-2021, 09:10 AM
Last Post: georgekasa
  How to crawl schema markup data type using scrapy? Nuwan16 1 3,122 Mar-31-2020, 03:42 PM
Last Post: stranac
  scrape data 1 go to next page scrape data 2 and so on alkaline3 6 5,313 Mar-13-2020, 07:59 PM
Last Post: alkaline3
  Scrapy-cut: Advanced Cookiecutter Scrapy Templating scriptso 2 4,709 Feb-02-2017, 07:57 PM
Last Post: scriptso

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020