Python Forum

Full Version: Python Scrapy Tutorial
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
A Tutorial series on the Scrapy Web Scraping Library. Scrapy is a rather advanced web scraping (the act of extracting data from the internet) library, so it's harder to learn than it's easier (but simpler) counterpart BeautifulSoup.

This tutorial series covers everything from the installation and setup of Scrapy, to using it's many advanced features like rotating proxies, user agents, link following and of course, Data extraction. Highly recommended for anyone interested in web scraping.

If you're a BeautifulSoup user, or having a hard time picking between either Scrapy or BeautifulSoup, you can read this comparison article that describes all of Scrapy's advanced features.