Python Forum
the next_page command using Scrapy Splash is not working
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
the next_page command using Scrapy Splash is not working
#1
Dear Everyone,

I am trying to extract all quotes with author and tags from 'http://quotes.toscrape.com/js'. The page uses Javascript for web content. Therefore I am using Splash with scrapy. The spider codes extract the information on the very first page but do not extract information from other pages. Could you please give me guidelines to fix the next_page command? I appreciate your help.
engine] INFO: Spider closed (finished)
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Scrapy-Splash installation on windows 10 dsuk 0 2,236 Aug-27-2020, 05:45 AM
Last Post: dsuk
  Scrapy Javascript Pagination (next_page) nazmulfinance 2 3,020 Nov-18-2019, 01:01 AM
Last Post: nazmulfinance
  Python - Scrapy Javascript Pagination (next_page) Baggelhsk95 3 9,987 Oct-08-2018, 01:20 PM
Last Post: stranac
  Scrapy-cut: Advanced Cookiecutter Scrapy Templating scriptso 2 4,650 Feb-02-2017, 07:57 PM
Last Post: scriptso

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020