Python Forum
urllib2.urlopen() user agent header
Thread Rating:
  • 1 Vote(s) - 4 Average
  • 1
  • 2
  • 3
  • 4
  • 5
urllib2.urlopen() user agent header
#9
https://github.com/python/cpython/blob/2...b2.py#L336 Wrote:
class OpenerDirector:
   def __init__(self):
       client_version = "Python-urllib/%s" % __version__
       self.addheaders = [('User-agent', client_version)]

So the default opener for urllib always includes the user agent, at init.  So there's no option to disable it... but you can just create an opener and clear that header out of it.  Something like this?
import urllib2
opener = urllib2.build_opener()
opener.addheaders = [header for header in opener.addheaders if header[0] != "User-agent"]
urllib2.install_opener(opener)

# now you can use urllib2.open() normally, without the useragent header
data = urllib2.open("https://python-forum.io")
Reply


Messages In This Thread
urllib2.urlopen() user agent header - by Skaperen - Jun-29-2017, 02:47 AM
RE: urllib2.urlopen() user agent header - by wavic - Jun-29-2017, 08:49 AM
RE: urllib2.urlopen() user agent header - by wavic - Jul-01-2017, 12:27 PM
RE: urllib2.urlopen() user agent header - by nilamo - Jul-14-2017, 05:36 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Can urlopen be blocked by websites? peterjv26 2 3,631 Jul-26-2020, 06:45 PM
Last Post: peterjv26
  malformed header from script 'main.py': Bad header: * Serving Flask app "main" anuragsapanbharat 2 4,693 Jun-12-2019, 07:26 AM
Last Post: anuragsapanbharat
  SSLCertVerificationError using urllib (urlopen) FalseFact 1 6,074 Mar-31-2019, 08:34 AM
Last Post: snippsat
  Error: module 'urllib' has no attribute 'urlopen' mitmit293 2 15,355 Jan-29-2019, 02:32 PM
Last Post: snippsat
  [Errno11004] Get addrinfo failed with urlopen prashanth0988 2 14,023 Aug-02-2018, 01:41 PM
Last Post: iiooii
  urllib request urlopen? nutgut 4 5,714 Apr-14-2018, 01:12 PM
Last Post: nutgut
  urllib urlopen getting error 400 on 1 specific page glidecode 4 4,319 Mar-01-2018, 11:01 PM
Last Post: glidecode

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020