(Jul-11-2020, 02:43 PM)j.crater Wrote: Your code works well and I can definitely continue from here. Frankly, I have no idea what was different on my attempt this time, since using requests.get() and B.S. gave good results on my first try.They may have changes source,so now is almost all code generated bye JavaScript.
(Jul-11-2020, 02:43 PM)j.crater Wrote: Given your examples with B.S. and Selenium, can Selenium replace B.S. entirely for use with scraping/navigating websites?You use Selenium only when it's necessary and can not get content only using Requests/BS.
This is usually the case with heavy sites eg to pick a example stock exchanges sites that we have many Thread about.
To better understand what JavaScript DOM(Document Object Model) dos in browser.
Use this address as before:
https://www.youtube.com/results?search_query=pythonNow turn off JavaScript in Browser,the reload page what do you see now?
