Python Forum
Why is grequests.map() so slow?
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Why is grequests.map() so slow?
#1
So. I am getting links from a website. Storing them in array and then iterating over them.

rs = (grequests.get(d) for d in data)
responses = grequests.map(rs)
But the grequests.map() is sooooo slow. Any idea what can cause this? Or I am not using it right. Or maybe there is better library or a way to send async request to links to check if they work.

I need to make this program fast because there is approx 70 links per page.

And also is there a way to get response code with grequests?
Reply


Messages In This Thread
Why is grequests.map() so slow? - by M1ck0 - Jul-21-2019, 08:08 AM
RE: Why is grequests.map() so slow? - by M1ck0 - Jul-21-2019, 09:38 AM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020