python批量请求url_使用PythonRequests伪装成浏览器请求百度360获取关键词批量排名...

使用Python Requests伪装成浏览器请求百度360获取关键词批量排名

#!/usr/local/python/bin/python3.7

import requests,re,time,random,string

#error&＃61;&＃39;360搜索_访问异常出错&＃39; #360

error&＃61;"location.href.replace" #baidu

url&＃61;["www.a.com", "www.b.com"] #你要查询的网址&＃xff0c;可以是多个

uaList &＃61; [&＃39;Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36&＃39;,&＃39;Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.100 Safari/537.36&＃39;]

with open(&＃39;a.txt&＃39;,&＃39;r&＃39;) as f: #查询的关键词保存在同一目录下a. txt

c&＃61;list(f.readlines())

for i in c:

ci&＃61;(i.rstrip("\n"))

u&＃61;&＃39;https://www.baidu.com/s?wd&＃61;{}&＃39;.format(ci)

#u&＃61;&＃39;https://so.com/s?&q&＃61;{}&pn&＃61;1&＃39;.format(ci)

sj&＃61;random.randrange(10,15)

#time.sleep(sj)

header&＃61;{&＃39;User-Agent&＃39;: random.choice(uaList)}

a&＃61;requests.get(u,headers&＃61;header).content.decode(&＃39;utf-8&＃39;)

if error in a:

print(ci,"error")

continue

lb&＃61;re.findall(r"\"text-decoration\:none\;\"\>(.*)?\;\",a)

strlb&＃61;&＃39;&＃39;.join(lb)

z&＃61;"不在"

for i in url:

if i in strlb:

z&＃61;"在"

break

print(ci,z)

©著作权归作者所有&＃xff1a;来自51CTO博客作者薛文昌的原创作品&＃xff0c;如需转载&＃xff0c;请注明出处&＃xff0c;否则将追究法律责任

每一份赞赏源于懂得

赞赏

0人进行了赞赏支持

薛文昌

55篇文章&＃xff0c;125W&＃43;人气&＃xff0c;7粉丝