Python Forum
Scraping using Scrapy - Printable Version

+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: Web Scraping & Web Development (https://python-forum.io/forum-13.html)
+--- Thread: Scraping using Scrapy (/thread-28548.html)



Scraping using Scrapy - userskipper - Jul-23-2020

Hi guys, I am new to Scrapy as well as this forum. I need to scrape data from an infinite scrolling page on property rental price. My problem is I cant seem to request for the page as I passed in the Request URL as stated in Headers of XHR fetch in Network tab(the one with page={}). I always get error 404 when running my python code as well as accessing the link in browser. I've tried with other pages and able to get the responses. I cant seem to find any discussions related to this matter. Please help me.

Here is a snippet of the link.
https://ibb.co/khnSk9F