Python Forum
I need help parsing through data and creating a database using beautiful soup
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
I need help parsing through data and creating a database using beautiful soup
#1
I am a new programmer and I am working on a project to scrape each product of a website and aggregate all the information into a database. This is the website https://www.selectedvendors.com/Goods/ca...3/Cabinets

There is a detail button for each product. I would like to go to each detail page and save all the information pertaining to that item in a database. This is the code that I have so far, I am using python3.8 and BeautifulSoup4

https://pastebin.com/ZZGe8PUb

All help is appreciated, Thank you all so much! Angel Angel Angel
Reply
#2
There are ample examples of web scraping on this forum.

I suggest you start here:
web scraping part1
web scraping part2
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  How to detect abnormal data in big database python vanphuht91 5 1,063 Jun-27-2023, 11:22 PM
Last Post: Skaperen
  Database that can compress a column, or all data, automatically? Calab 3 1,119 May-22-2023, 03:25 AM
Last Post: Calab
Video doing data treatment on a file import-parsing a variable EmBeck87 15 2,665 Apr-17-2023, 06:54 PM
Last Post: EmBeck87
  Basic SQL query using Py: Inserting or querying sqlite3 database not returning data marlonbown 3 1,303 Nov-08-2022, 07:16 PM
Last Post: marlonbown
  json api data parsing elvis 0 902 Apr-21-2022, 11:59 PM
Last Post: elvis
  Modify values in XML file by data from text file (without parsing) Paqqno 2 1,575 Apr-13-2022, 06:02 AM
Last Post: Paqqno
  Trouble selecting attribute with beautiful soup bananatoast 3 1,567 Jan-30-2022, 10:01 AM
Last Post: bananatoast
  Error creating database with python and form? shams 3 2,327 Aug-02-2021, 02:00 PM
Last Post: deanhystad
  SaltStack: MySQL returner save less data into Database table columns xtc14 2 2,112 Jul-02-2021, 02:19 PM
Last Post: xtc14
  How can I scroll over my data points when creating plots in Python? (I'm using Spyder moose 0 1,581 Nov-02-2020, 07:18 AM
Last Post: moose

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020