(Jun-09-2020, 04:48 PM)alexkorn Wrote: I am trying to install Scrapy.Use Twisted wheel from Gohlke.
pip install Twisted‑20.3.0‑cp38‑cp38‑win_amd64.whl pip install scrapy
(Jun-09-2020, 07:49 AM)alexkorn Wrote: I have a very small project, from the page I need to get only 10 products. I think Scrapy is like shooting a sparrow from a tank.Yes it can complicate stuff if not need so much,
and Scrapy will not do JavaScript stuff like scrolling by default may need to use scrapy-splash or integrate Selenium.
If use Selenium alone the scrolling can be done bye this command.
browser.execute_script("window.scrollTo(0, 100000);")