Python Forum

Hi guys,

Is it possible to extract all data from the site, while site is showing more results each time when user is scrolling down?

I would love to do this by using BeautifulSoup.

I have tried Selenium, but couldn't even once get a text from any element :(

It is javascript that is showing results based on whether it is scrolled down, requiring you to use selenium to scroll and obtain the results.

What is your code and the website? Most likely you are parsing the HTML incorrectly.