Python Forum
MaxRetryError while scraping a website multiple times
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
MaxRetryError while scraping a website multiple times
#1
Hi,

I have been trying to retrieve some data from a website. My initial test for retrieving one time data worked as expected, but when I try to get the data from 2 or more links of the same website I receive the below error.
I am new to webscraping, and I am doing it using BeautifulSoup, Requests, Selenium and Pandas. I also added a timer for sleeping between queries. Any idea of the root cause and a possible workaround for it?


Error:
MaxRetryError: HTTPConnectionPool(host='127.0.0.1', port=57192): Max retries exceeded with url: /session/dcba731d4173518f03b593a17afe111c/url (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x0000001DD4212470>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it'))
Thanks
Reply


Messages In This Thread
MaxRetryError while scraping a website multiple times - by kawasso - Aug-26-2019, 11:21 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
Information Web-scraping, multiple webpages Pabloty92 1 1,280 Dec-28-2022, 02:09 PM
Last Post: Yoriz
  web scraping for new additions/modifed website? kingoman123 4 2,243 Apr-14-2022, 04:46 PM
Last Post: snippsat
  Scraping lender data from Ren Ren Dai website using Python. I will pay for that 200$ Hafedh_2021 1 2,755 May-18-2021, 08:41 PM
Last Post: snippsat
  Scraping all website text using Python MKMKMKMK 1 2,087 Nov-26-2020, 10:35 PM
Last Post: Larz60+
  scraping multiple pages from table bandar 1 2,697 Jun-27-2020, 10:43 PM
Last Post: Larz60+
  Scraping a Website (HELP) LearnPython2 1 1,752 May-08-2020, 03:20 PM
Last Post: Larz60+
  Scraping Multiple Pages mbadatanut 1 4,231 May-08-2020, 02:30 AM
Last Post: Larz60+
  scraping from a website that hides source code PIWI_Protein 1 1,965 Mar-27-2020, 05:08 PM
Last Post: Larz60+
  Scraping not moving to the next pages in a website jithin123 0 1,953 Mar-23-2020, 06:10 PM
Last Post: jithin123
  Scraping from multiple URLS to print in a single line. jb89 4 3,368 Jan-29-2020, 06:12 AM
Last Post: perfringo

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020