Bottom Page

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
 scrolldown + beautifulsoup?
#1
Hi guys,

Is it possible to extract all data from the site, while site is showing more results each time when user is scrolling down?

I would love to do this by using BeautifulSoup.

I have tried Selenium, but couldn't even once get a text from any element :(
Quote
#2
It is javascript that is showing results based on whether it is scrolled down, requiring you to use selenium to scroll and obtain the results.

What is your code and the website? Most likely you are parsing the HTML incorrectly.
Quote

Top Page

Forum Jump:


Users browsing this thread: 1 Guest(s)