Python Forum
Detect comments part using web scraping
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Detect comments part using web scraping
#1
Hi
I'm following this tutorial to scrape Ajax comments section from a website https://likegeeks.com/python-web-scraping/

I'm using both beautifulSoup and selenium to scrape Ajax comments.
The article shows how to scrape ajax content, but I'm asking:
Is there a way to detect that this section is the content section regardless the scraped website? like an advanced scraping library or so?

Thanks in advance.
Reply


Messages In This Thread
Detect comments part using web scraping - by seco - Jan-18-2018, 08:06 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Two part scraping? never5000 1 1,299 Feb-23-2022, 03:49 PM
Last Post: snippsat
  Instagram Bot _ Posting Comments kristianpython 3 3,355 May-23-2020, 12:54 PM
Last Post: kristianpython
  Post comments to Wordpress Blog SergeyLV 1 2,500 Aug-01-2019, 01:38 AM
Last Post: Larz60+
  Form add tree comments with mptt m0ntecr1st0 1 2,520 Feb-23-2019, 01:50 PM
Last Post: m0ntecr1st0
  Questions abou Web-scraping part-2 Tutorial ljmetzger 2 2,813 Mar-25-2018, 09:14 PM
Last Post: ljmetzger
  BS4 Not Able To Find Text In CSS Comments digitalmatic7 4 5,252 Feb-27-2018, 03:45 AM
Last Post: digitalmatic7
  Need comments on content/style of my first project league55 2 3,019 Jan-24-2018, 08:20 AM
Last Post: league55

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020