Bottom Page

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
 Download article without photo caption

I am using the newspaper3k to download newspaper articles to .txt files. However, is there any way to only download the actual article, i.e. not the photo captions or links forwarding the reader to other articles? Example: Copy this article without including the text "Emirates and Airbus both said Thursday that the A380 remains highly popular with passengers." which is a caption to the photo? Likewise, not include text that says "related article: xxx" or "Did you read this xxx" which is often in the middle of the article.

YOU can use the library 'beautiful soup', that is covered in the book 'Web scrapping with Python' (Ryan Mitchell).
(Feb-14-2019, 12:37 PM)AlekseyPython Wrote: that is covered in the book 'Web scrapping with Python' (Ryan Mitchell).
We have updated tutorial here,so no reason to buy that book from 2015(which use BeautifulSoup 3(new now is bs4 and also not using Requests).
Web-Scraping part-1
Web-scraping part-2
buran likes this post

Top Page

Possibly Related Threads...
Thread Author Replies Views Last Post
  download pdf file from website m_annur2001 1 196 Jun-21-2019, 05:03 AM
Last Post: j.crater
  Access my webpage and download files from Python Pedroski55 7 377 May-26-2019, 12:08 PM
Last Post: snippsat
  Download images generated by user input one_of_us 0 314 Mar-26-2019, 07:58 AM
Last Post: one_of_us
  Flask generating a file for download darktitan 0 499 Dec-30-2018, 02:02 PM
Last Post: darktitan
  I wan't to Download all .zip Files From A Website (Project AI) eddywinch82 68 5,940 Oct-28-2018, 02:13 PM
Last Post: eddywinch82
  help about requests download ggbaby 1 412 Sep-18-2018, 03:44 AM
Last Post: wavic
  Download all secret links from a map design website fyec 0 590 Jul-24-2018, 09:08 PM
Last Post: fyec
  I Want To Download Many Files Of Same File Extension With Either Wget Or Python, eddywinch82 15 3,173 May-20-2018, 06:05 PM
Last Post: eddywinch82
  Download data parthi1705 3 714 Apr-20-2018, 03:42 PM
Last Post: Larz60+
  Execute using Html, Save data into Database and Download in CSV in Django --Part 1 Prince_Bhatia 0 1,239 Jan-19-2018, 06:05 AM
Last Post: Prince_Bhatia

Forum Jump:

Users browsing this thread: 1 Guest(s)