Python爬虫练习：爬取阴阳师高清大图

本文的文字及图片来源于网络,仅供学习、交流使用,不具有任何商业用途,如有问题请及时联系我们以作处理。

• python 3.6
• pycharm
• requests

相关模块pip安装即可

经过一些系列的网页分析&＃xff0c;可以发现它的图片地址

https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_beforeAwake/201.png
https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_afterAwake/201.png
https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_skin/201-1.png

多看几张式神的图片后可以发现&＃xff0c;每个图片所改变的是式神的 ID 值

可以通过开发者工具抓包&＃xff0c;找到数据接口

• 获得json数据

import requests
url &＃61; &＃39;https://yys.res.netease.com/pc/zt/20161108171335/js/app/all_shishen.json&＃39;
headers &＃61; {&＃39;user-agent&＃39;: &＃39;Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36&＃39;
}
response &＃61; requests.get(url&＃61;url, headers&＃61;headers)
html_data &＃61; response.json()
解析数据

• 获取 id 值 以及 式神名字
• 构建图片地址

for i in html_data:num_id &＃61; i[&＃39;id&＃39;]name &＃61; i[&＃39;name&＃39;]beforeAwake &＃61; &＃39;https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_beforeAwake/{}.png&＃39;.format(num_id)afterAwake &＃61; &＃39;https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_afterAwake/{}.png&＃39;.format(num_id)skin &＃61; &＃39;https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_skin/{}-1.png&＃39;.format(num_id)beforeAwake_response &＃61; requests.get(url&＃61;beforeAwake, headers&＃61;headers)beforeAwake_name &＃61; name &＃43; &＃39;初始&＃39; &＃43; &＃39;.png&＃39;afterAwake_response &＃61; requests.get(url&＃61;beforeAwake, headers&＃61;headers)afterAwake_name &＃61; name &＃43; &＃39;觉醒&＃39; &＃43; &＃39;.png&＃39;skin_response &＃61; requests.get(url&＃61;beforeAwake, headers&＃61;headers)skin_name &＃61; name &＃43; &＃39;皮肤&＃39; &＃43; &＃39;.png&＃39;
保存数据

path &＃61; &＃39;D:\\python\\demo\\阴阳师\\img\\&＃39;
def download(name, response):with open(path &＃43; name, mode&＃61;&＃39;wb&＃39;) as f:f.write(response.content)
完整代码

import requests
import pprint
url &＃61; &＃39;https://yys.res.netease.com/pc/zt/20161108171335/js/app/all_shishen.json&＃39;
path &＃61; &＃39;D:\\python\\demo\\阴阳师\\img\\&＃39;headers &＃61; {&＃39;user-agent&＃39;: &＃39;Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36&＃39;
}
def download(name, response):with open(path &＃43; name, mode&＃61;&＃39;wb&＃39;) as f:f.write(response.content)response &＃61; requests.get(url&＃61;url, headers&＃61;headers)
html_data &＃61; response.json()
for i in html_data:num_id &＃61; i[&＃39;id&＃39;]name &＃61; i[&＃39;name&＃39;]beforeAwake &＃61; &＃39;https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_beforeAwake/{}.png&＃39;.format(num_id)afterAwake &＃61; &＃39;https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_afterAwake/{}.png&＃39;.format(num_id)skin &＃61; &＃39;https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_skin/{}-1.png&＃39;.format(num_id)beforeAwake_response &＃61; requests.get(url&＃61;beforeAwake, headers&＃61;headers)beforeAwake_name &＃61; name &＃43; &＃39;初始&＃39; &＃43; &＃39;.png&＃39;download(beforeAwake_name, beforeAwake_response)afterAwake_response &＃61; requests.get(url&＃61;beforeAwake, headers&＃61;headers)afterAwake_name &＃61; name &＃43; &＃39;觉醒&＃39; &＃43; &＃39;.png&＃39;download(afterAwake_name, afterAwake_response)skin_response &＃61; requests.get(url&＃61;beforeAwake, headers&＃61;headers)skin_name &＃61; name &＃43; &＃39;皮肤&＃39; &＃43; &＃39;.png&＃39;download(skin_name, skin_response)print(&＃39;正在下载{}图鉴&＃39;.format(name))
实现效果