Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Web scraping for search results
#8
HI, I have changed the code to certain aspect and successfully getting the required output.
Need help to understand what went wrong further. I have to get data further under col-7, col-8, col-9, col-10.
But when i add those code line, it gives error "unindent does not match any outer indentation level"

The working code is given below

import xlsxwriter
from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager

element_list = []

for page in range(1, 3, 1):
	
	page_url = "/results?_=false&searchType=quickSearch" + str(page)
	driver = webdriver.Chrome(ChromeDriverManager().install())
	driver.get(page_url)
	title = driver.find_elements_by_class_name("col-3")
	name = driver.find_elements_by_class_name("col-4")
	type = driver.find_elements_by_class_name("col-5")
	date = driver.find_elements_by_class_name("col-6")
    

	for i in range(len(title)):
		element_list.append([title[i].text, name[i].text, type[i].text,  date[i].text])

with xlsxwriter.Workbook(r'C:\Users\Desktop\list.xlx') as workbook:
	worksheet = workbook.add_worksheet()

	for row_num, data in enumerate(element_list):
		worksheet.write_row(row_num, 0, data)

driver.close()
 
Reply


Messages In This Thread
Web scraping for search results - by JOE - May-14-2022, 06:32 AM
RE: Web scraping for search results - by ndc85430 - May-14-2022, 06:41 AM
RE: Web scraping for search results - by JOE - May-14-2022, 07:20 AM
RE: Web scraping for search results - by JOE - May-14-2022, 07:33 AM
RE: Web scraping for search results - by snippsat - May-14-2022, 08:01 AM
RE: Web scraping for search results - by JOE - May-14-2022, 08:34 AM
RE: Web scraping for search results - by JOE - May-14-2022, 08:37 AM
RE: Web scraping for search results - by JOE - May-14-2022, 01:19 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  web scraping football results and odds terrasamba77 1 2,923 Mar-28-2024, 10:21 AM
Last Post: 22206290
  Web Scraping (Results not appearing) TheBadLeopard 4 2,801 Oct-17-2019, 04:56 PM
Last Post: TheBadLeopard
  How to use BeautifulSoup to parse google search results DevinGP 16 21,580 Dec-22-2017, 10:23 PM
Last Post: snippsat
  Outputing the results of search machine Emmanouil 4 5,126 Nov-07-2016, 05:20 PM
Last Post: nilamo

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020