Python beautifulsoup pagination error

Thread Rating:

Thread Modes

Python beautifulsoup pagination error

Larz60+
aetate et sapientia
Super Moderators

Posts: 11,875

Threads: 474

Joined: Sep 2016

Reputation: 452

Apr-08-2020, 03:06 AM

what would your search word be?
comment out line 30, then
after line 29, add:

    newurl = f"https://eksisozluk.com/{word}?p={str(num)}"
    print(newurl)
    pageRequest = requests.get(newurl, headers=header_param)

what do you get?
does the newurl look proper?

Messages In This Thread

RE: Python beautifulsoup pagination error - by Larz60+ - Apr-08-2020, 03:06 AM

Possibly Related Threads…
Thread		Author	Replies	Views	Last Post
	Strange ModuleNotFound Error on BeautifulSoup for Python 3.11	Gaberson19	1	1,043	Jul-13-2023, 10:38 AM Last Post: Gaurav_Kumar
	[Solved]Help with BeautifulSoup.getText() Error	Extra	5	3,827	Jan-19-2023, 02:03 PM Last Post: prvncpa
	Python BeautifulSoup gives unusable text?	dggo666	0	1,450	Oct-29-2021, 05:12 AM Last Post: dggo666
	BeautifulSoup pagination using href	rhat398	1	2,435	Jun-30-2021, 10:55 AM Last Post: snippsat
	Python BeautifulSoup IndexError: list index out of range	rhat398	1	6,276	May-28-2021, 09:09 PM Last Post: Daring_T
	Python 3.9 : BeautifulSoup: 'NoneType' object has no attribute 'text'	fudgemasterultra	1	8,965	Mar-03-2021, 09:40 AM Last Post: Larz60+
	Error with NumPy, BeautifulSoup when using pip	tsurubaso	7	5,365	Oct-20-2020, 04:34 PM Last Post: tsurubaso
	Beautifulsoup doesn't scrape page (python 2.7)	Hikki	0	2,016	Aug-01-2020, 05:54 PM Last Post: Hikki
	Pagination	prejni	2	2,421	Nov-18-2019, 10:45 AM Last Post: alekson
	Scrapy Javascript Pagination (next_page)	nazmulfinance	2	3,055	Nov-18-2019, 01:01 AM Last Post: nazmulfinance

Users browsing this thread: 1 Guest(s)