+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: General Coding Help (https://python-forum.io/forum-8.html)
+--- Thread: I need help parsing through data and creating a database using beautiful soup (/thread-34987.html)
I need help parsing through data and creating a database using beautiful soup - username369 - Sep-22-2021
I am a new programmer and I am working on a project to scrape each product of a website and aggregate all the information into a database. This is the website https://www.selectedvendors.com/Goods/categoryGoodsList/53/Cabinets
There is a detail button for each product. I would like to go to each detail page and save all the information pertaining to that item in a database. This is the code that I have so far, I am using python3.8 and BeautifulSoup4
https://pastebin.com/ZZGe8PUb
All help is appreciated, Thank you all so much!
RE: I need help parsing through data and creating a database using beautiful soup - Larz60+ - Sep-22-2021
There are ample examples of web scraping on this forum.
I suggest you start here:
web scraping part1
web scraping part2