Apr-12-2020, 03:43 AM
I use selenium and scrapy alot for web scraping.
Here are the main reasons I like those:
Selenium:
can access dynamic page
access iframe
it seems to have no robot.txt issue
script:
alternative much faster
automatic
handle a lot feature that I don't need to handwriting it
is there any other library that is good to use, and especially can combine both features?
is there any library can be fast, automatic, and solve dynamic page issue?
Here are the main reasons I like those:
Selenium:
can access dynamic page
access iframe
it seems to have no robot.txt issue
script:
alternative much faster
automatic
handle a lot feature that I don't need to handwriting it
is there any other library that is good to use, and especially can combine both features?
is there any library can be fast, automatic, and solve dynamic page issue?