Python requests to loop over the list and click button

[hbknjr]

See there's a difference between scraping data from a static page and interacting with the page and the elements on it.(using DOM and JavaScript)

Eg:
bs4 and requests modules can scrap data from both URLs below.
https://www.google.com and https://www.google.co.in/search?q=python.

But what they can't do is to type search query ("python") into the Google's search box and press enter.

For that, you need to use selenium, splinter or any other browser automation tool.

In your case, you are required to interact with the page in order to get to the URL where actual data resides.