Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Which library to use
#2
If you need to execute JavaScript on the Page, you can look for https://selenium-python.readthedocs.io/
This runs a browser session (Firefox, Chrome or other) and you have control over this session.

If you just want to grab content from a page without this dedicated browser session, you should look for requests and Requests-HTML (also JS support).

Another library which is built on top of html.parser/lxml is BeautifulSoup 4, which is a little bit tricky to handle.


EDIT: I used one minute ago requests_html to download something from a web page on my server, where a login is required. This library is very cool. It worked directly :-)
Almost dead, but too lazy to die: https://sourceserver.info
All humans together. We don't need politicians!
Reply


Messages In This Thread
Which library to use - by Dbeah - Oct-29-2018, 07:27 AM
RE: Which library to use - by DeaD_EyE - Oct-29-2018, 11:23 AM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020