Python Forum
urllib2.urlopen() user agent header
Thread Rating:
  • 1 Vote(s) - 4 Average
  • 1
  • 2
  • 3
  • 4
  • 5
urllib2.urlopen() user agent header
#9
https://github.com/python/cpython/blob/2...b2.py#L336 Wrote:
class OpenerDirector:
   def __init__(self):
       client_version = "Python-urllib/%s" % __version__
       self.addheaders = [('User-agent', client_version)]

So the default opener for urllib always includes the user agent, at init.  So there's no option to disable it... but you can just create an opener and clear that header out of it.  Something like this?
import urllib2
opener = urllib2.build_opener()
opener.addheaders = [header for header in opener.addheaders if header[0] != "User-agent"]
urllib2.install_opener(opener)

# now you can use urllib2.open() normally, without the useragent header
data = urllib2.open("https://python-forum.io")
Reply


Messages In This Thread
urllib2.urlopen() user agent header - by Skaperen - Jun-29-2017, 02:47 AM
RE: urllib2.urlopen() user agent header - by wavic - Jun-29-2017, 08:49 AM
RE: urllib2.urlopen() user agent header - by wavic - Jul-01-2017, 12:27 PM
RE: urllib2.urlopen() user agent header - by nilamo - Jul-14-2017, 05:36 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Can urlopen be blocked by websites? peterjv26 2 3,641 Jul-26-2020, 06:45 PM
Last Post: peterjv26
  malformed header from script 'main.py': Bad header: * Serving Flask app "main" anuragsapanbharat 2 4,697 Jun-12-2019, 07:26 AM
Last Post: anuragsapanbharat
  SSLCertVerificationError using urllib (urlopen) FalseFact 1 6,081 Mar-31-2019, 08:34 AM
Last Post: snippsat
  Error: module 'urllib' has no attribute 'urlopen' mitmit293 2 15,366 Jan-29-2019, 02:32 PM
Last Post: snippsat
  [Errno11004] Get addrinfo failed with urlopen prashanth0988 2 14,032 Aug-02-2018, 01:41 PM
Last Post: iiooii
  urllib request urlopen? nutgut 4 5,722 Apr-14-2018, 01:12 PM
Last Post: nutgut
  urllib urlopen getting error 400 on 1 specific page glidecode 4 4,327 Mar-01-2018, 11:01 PM
Last Post: glidecode

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020