Mar-21-2022, 05:31 PM
Hello,
I am trying to scrape a dynamic web page. The code I use is:
Question 2: How do I feed the rendered HTML to Beautifulsoup?
Thank you!
I am trying to scrape a dynamic web page. The code I use is:
from requests_html import HTMLSession from bs4 import BeautifulSoup session = HTMLSession() url = 'someurlhere' r = session.get(url) r.html.render(keep_page=True, sleep=1,timeout=10,wait=2)Question 1: How do I save the rendered HTML to file?
Question 2: How do I feed the rendered HTML to Beautifulsoup?
Thank you!