Failure in web scraping by Beautiful Soup

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Thread Modes

Failure in web scraping by Beautiful Soup

metulburr
The Castle of aaarrrrggh
Administrators

Posts: 5,151

Threads: 396

Joined: Sep 2016

Reputation: 170

Mar-17-2019, 10:18 AM

based on this

Quote:GenericErrorMessageCookies="Cookies must be enabled in order to view this page.";

I would suggest that your program is not using cookies.

(Mar-17-2019, 08:16 AM)yeungcase Wrote: I did check my browser setting and cookies are enabled.

Your browser settings has nothing to do with requests in python as that is what is sending the request data. Are you sending the cookie via requests module?

Show us your code.

Recommended Tutorials:

Find

Messages In This Thread

Failure in web scraping by Beautiful Soup - by yeungcase - Mar-17-2019, 08:16 AM

RE: Failure in web scraping by Beautiful Soup - by metulburr - Mar-17-2019, 10:18 AM

RE: Failure in web scraping by Beautiful Soup - by yeungcase - Mar-19-2019, 01:04 PM

RE: Failure in web scraping by Beautiful Soup - by yeungcase - Mar-23-2019, 06:49 AM

RE: Failure in web scraping by Beautiful Soup - by metulburr - Mar-23-2019, 12:36 PM

Possibly Related Threads…
Thread		Author	Replies	Views	Last Post
	Beautiful Soup - access a rating value in a class	KatMac	1	4,382	Apr-16-2021, 01:27 PM Last Post: snippsat
	Beginner web scraping/Beautiful Soup help	7ken8	2	3,875	Jan-28-2021, 04:26 PM Last Post: 7ken8
	Help: Beautiful Soup - Parsing HTML table	ironfelix717	2	3,895	Oct-01-2020, 02:19 PM Last Post: snippsat
	Beautiful Soup (suddenly) doesn't get full webpage html	j.crater	8	30,026	Jul-11-2020, 04:31 PM Last Post: j.crater
	Requests-HTML vs Beautiful Soup - How to Choose?	robin73	0	4,448	Jun-23-2020, 02:53 PM Last Post: robin73
	looking for direction - scrappy, crawler, beautiful soup	Sly_Corn	2	3,352	Mar-17-2020, 03:17 PM Last Post: Sly_Corn
	Beautiful soup truncates results	jonesjoz	4	5,389	Mar-09-2020, 06:04 PM Last Post: jonesjoz
	Beautiful soup and tags	starter_student	11	8,820	Jul-08-2019, 03:41 PM Last Post: starter_student
	Beautiful Soup find_all()	kirito85	2	4,295	Jun-14-2019, 02:17 AM Last Post: kirito85
	[split] Using beautiful soup to get html attribute value	moski	6	7,898	Jun-03-2019, 04:24 PM Last Post: moski

Users browsing this thread: 1 Guest(s)

View a Printable Version

Failure in web scraping by Beautiful Soup

User Panel Messages

Announcements