Nov-17-2019, 03:23 PM
(This post was last modified: Nov-17-2019, 03:23 PM by nazmulfinance.)
Dear Members,
I am trying to scrap the first table in all pages from the following website: https://www.secform4.com/insider-trading/320193.htm. The website uses Javascript to do the pagination. I know I need to use Scrapy Splash for the pagination but do not know how to code it. With my codes, I get the data from the first page only. It means my next_page command does not work. Could you please help me to do the pagination using Scrapy Splash?
I am trying to scrap the first table in all pages from the following website: https://www.secform4.com/insider-trading/320193.htm. The website uses Javascript to do the pagination. I know I need to use Scrapy Splash for the pagination but do not know how to code it. With my codes, I get the data from the first page only. It means my next_page command does not work. Could you please help me to do the pagination using Scrapy Splash?