+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: Web Scraping & Web Development (https://python-forum.io/forum-13.html)
+--- Thread: Scrapy Javascript Pagination (next_page) (/thread-22541.html)
Scrapy Javascript Pagination (next_page) - nazmulfinance - Nov-17-2019
Dear Members,
I am trying to scrap the first table in all pages from the following website: https://www.secform4.com/insider-trading/320193.htm. The website uses Javascript to do the pagination. I know I need to use Scrapy Splash for the pagination but do not know how to code it. With my codes, I get the data from the first page only. It means my next_page command does not work. Could you please help me to do the pagination using Scrapy Splash?
RE: Scrapy Javascript Pagination (next_page) - Larz60+ - Nov-17-2019
what have you tried so far?
Please show code
RE: Scrapy Javascript Pagination (next_page) - nazmulfinance - Nov-18-2019
Dear Larz60+
I find a solution on Youtube. Thank you for your help.