Python Forum
Thread Rating:
  • 1 Vote(s) - 2 Average
  • 1
  • 2
  • 3
  • 4
  • 5
web scraping with selenium and bs4
#3
error is coming at line 79 which is this:

geta = i.find_elements_by_tag_name("a")[1]
so this is how it should work:
main page has links , click the links, open url, grab url and then close the url and go to main page and start process again
Reply


Messages In This Thread
RE: web scraping with selenium and bs4 - by wavic - Sep-18-2018, 10:37 AM
RE: web scraping with selenium and bs4 - by Prince_Bhatia - Sep-18-2018, 10:59 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Scraping div tags with selenium, need help hfakoor2 1 1,075 Mar-12-2023, 08:31 AM
Last Post: hfakoor2
  Web scraping cookie in URL blocks selenium Alex06 2 2,450 Jan-10-2021, 01:43 PM
Last Post: Alex06
  Web scraping (selenium (i think)) Larz60+ 10 6,221 Jan-27-2019, 02:57 AM
Last Post: Larz60+
  Web Page not opening while web scraping through python selenium sumandas89 4 10,107 Nov-19-2018, 02:47 PM
Last Post: snippsat
  scraping javascript websites with selenium DoctorEvil 1 3,377 Jun-08-2018, 06:40 PM
Last Post: DoctorEvil
  Combining selenium and beautifulsoup for web scraping sumandas89 3 11,645 Jan-30-2018, 02:14 PM
Last Post: metulburr
  web scraping using selenium sumandas89 3 3,588 Jan-05-2018, 01:45 PM
Last Post: metulburr
  Error in Selenium: CRITICAL:root:Selenium module is not installed...Exiting program. AcszE 1 3,636 Nov-03-2017, 08:41 PM
Last Post: metulburr

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020