Python Forum
Python Forum

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Thread Modes
an issue with bs4 scraping
metulburr
The Castle of aaarrrrggh
Administrators
Posts: 5,150
Threads: 396
Joined: Sep 2016
Reputation: 170
#3
Oct-10-2017, 01:10 PM
Quote:it is probably a problem of the javascript
Most likely. The content is probably being injected in dynamically, and you can see it in your browser, but python + beautifulsoup cant.

If this is the case the only alternative is to use selenium to load the html content. As that will grab any javascript stuff.
Recommended Tutorials:
Find
Reply


Messages In This Thread
an issue with bs4 scraping - by komarek - Oct-10-2017, 12:53 PM
RE: an issue with bs4 scraping - by stranac - Oct-10-2017, 01:06 PM
RE: an issue with bs4 scraping - by metulburr - Oct-10-2017, 01:10 PM
RE: an issue with bs4 scraping - by snippsat - Oct-10-2017, 02:08 PM
RE: an issue with bs4 scraping - by komarek - Oct-11-2017, 03:42 PM
RE: an issue with bs4 scraping - by buran - Oct-11-2017, 06:31 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Size scraping issue scrapemasta 0 412 Feb-09-2024, 10:26 AM
Last Post: scrapemasta
Thumbs Up Issue facing while scraping the data from different websites in single script. Balamani 1 2,167 Oct-20-2020, 09:56 AM
Last Post: Larz60+
  POST request with form data issue web scraping hoff1022 1 2,726 Aug-14-2020, 10:25 AM
Last Post: kashcode
  Strange BS4 Scraping Issue digitalmatic7 1 2,439 Jan-14-2018, 04:34 PM
Last Post: wavic

Forum Jump:

User Panel Messages

Log Out
My Profile
Pay your profile a visit
User Control Panel
Do some changes on your profile
My Messages
View private messages unread
Avatar
Change avatar
Signature
Change signature
Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020