Python Forum
No links are getting added to the parsed_links variable
Thread Rating:
  • 2 Vote(s) - 3 Average
  • 1
  • 2
  • 3
  • 4
  • 5
No links are getting added to the parsed_links variable
#2
You run the indexer in another thread, but then never wait for the thread to finish.  So maybe the script finishes before the first page is even finished transferring over the network?

i = indexer(domain)
i.run()

# indexer is now running in a different thread, but you're not waiting for it to finish
# to wait for it to be done, use the .join() method:
i.join()
Reply


Messages In This Thread
RE: No links are getting added to the parsed_links variable - by nilamo - Jun-07-2017, 06:14 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  webscrapping links and then enter those links to scrape data kirito85 2 3,435 Jun-13-2019, 02:23 AM
Last Post: kirito85

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020