Python Forum

Full Version: All product links to products on a website
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Hello,

would like to scrape all product links from the website www.otto.de. Is this possible?
So not only the links on the page you are on, but also the subpages that follow from it?

I had already tried it by entering the letter a in the search bar and then the letter b, but it didn't show all the products with that letter, just a few. Is there a trick to typing a code into the search bar so that all the products in the whole shop are displayed to me?

I would like to be able to easily get the URLs of all the products in the shop!