pythonreferer伪造_Python标准库urllib2伪装http_referer和useragent访问

前面博客介绍了python标准库urllib2的基本使用和linux系统curl命令伪装http_referer和user-agent访问&＃xff0c;不懂的可以点击链接再看下。这篇文章继续以伪装为目的&＃xff0c;不过完全使用urllib2来实现。步骤如下&＃xff0c;先创建request对象&＃xff0c;然后修改request对象以增加header信息&＃xff0c;最后把request对象传递给urllib2的urlopen方法。

代码如下&＃xff1a;

#coding:utf-8

import urllib2

def visitWebsite(url,timeout&＃61;60):

req&＃61;urllib2.Request(url)

req.add_header(&＃39;Referer&＃39;, &＃39;https://zhangnq.com/&＃39;)

req.add_header(&＃39;User-Agent&＃39;,"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/31.0.1650.63 Safari/537.36")

try:

response&＃61;urllib2.urlopen(req,timeout&＃61;timeout)

print "Url: %s\t%s" % (url,response.getcode())

except urllib2.URLError as e:

if hasattr(e, &＃39;code&＃39;):

print "Url: %s\t%s" % (url,e.code)

elif hasattr(e, &＃39;reason&＃39;):

print "Url: %s\t%s" % (url,&＃39;error&＃39;)

except:

pass

finally:

if response:

response.close()

if __name__ &＃61;&＃61; &＃39;__main__&＃39;:

urls&＃61;[

&＃39;http://www.baidu.com/&＃39;,

&＃39;http://www.qq.com/&＃39;,

]

for url in urls:

visitWebsite(url)

这个伪装一般做网站采集可能会用到。好了&＃xff0c;就是那么简单。

参考网址&＃xff1a;https://zhangnq.com/2249.html