Python Forum
Long-term stable source to get news headlines with Python?
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Long-term stable source to get news headlines with Python?
#1
I am planning to do multiple data visualisations of the sentiment of real-time news headlines from different newspapers. The visualisations will be displayed on different sites (with pyhisical LED screens) for a long period. I am trying to find the best way with Python to get the news according to my needs:

  • The source has to be stable in its format because the piece its gonna last for a long period. That's why I am not sure about considering web scraping.

  • I want to be able to have multiple instances(let's say 10) of the visualisation each displaying different content. That's why I am not sure about using Twitter API, due to limited requests and having to depend on a Twitter account.
The only option that comes to my mind is using RSS feeds as its something solid and easy to integrate with Python, but at the same time the use of RSS feeds is in decline and less digital newspapers are using them. I would like to have as much access to different newspapers as possible.

You guys know any other options or have any tips on how to handle this?

Thanks in advance, Joan.
Reply
#2
check out: https://newsapi.org/
sandufi likes this post
Reply
#3
(Dec-22-2021, 04:36 PM)Larz60+ Wrote: check out: https://newsapi.org/

Thanks for the answer! I already know news API and it doesn't fit my needs. I cannot choose the newspappers I want to get the news from.
Reply
#4
Well, in a different direction, perhaps:
PyPi: https://pypi.org/project/newspaper3k/

GitHub: https://github.com/codelucas/newspaper/
Reply
#5
(Dec-23-2021, 12:41 AM)Larz60+ Wrote: Well, in a different direction, perhaps:
PyPi: https://pypi.org/project/newspaper3k/

GitHub: https://github.com/codelucas/newspaper/

I already know this source too Shy . It's not very reliable due to web scraping and I see lots of people having issues with it. Thanks tho for your link Smile .
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Algorithm for extracting comments from Python source code Pavel1982 6 524 Feb-28-2024, 09:52 PM
Last Post: Pavel1982
  PyRun_String equivalent in stable ABI nschloe 2 670 Sep-19-2023, 01:38 PM
Last Post: nschloe
Smile Newsi free News API for python mohammedalaazaki 0 468 Aug-18-2023, 06:53 AM
Last Post: mohammedalaazaki
  The term 'pip' is not recognized as the name of a cmdlet, function michaelnicol 1 629 Jul-16-2023, 11:12 PM
Last Post: deanhystad
  Sum of changing general term Vantin19 2 713 Apr-04-2023, 08:22 AM
Last Post: Gribouillis
  python move specific files from source to destination including duplicates mg24 3 1,098 Jan-21-2023, 04:21 AM
Last Post: deanhystad
  matrix multiplication term by term karolina 1 827 Dec-10-2022, 10:11 AM
Last Post: Gribouillis
  Python Snippets Source kucingkembar 0 633 Oct-18-2022, 12:50 AM
Last Post: kucingkembar
  How to transform from wide to long format in python shantanu97 1 1,657 Nov-21-2021, 11:53 AM
Last Post: buran
  Navigating cpython source using python quazirfan 3 2,024 Aug-09-2021, 07:52 PM
Last Post: quazirfan

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020