作者：阿凯宜_ | 来源：互联网 | 2023-09-05 17:19
这篇文章主要讲解了“python爬虫怎么实现下载豆瓣妹子图片”，文中的讲解内容简单清晰，易于学习与理解，下面请大家跟着小编的思路慢慢深入，一起来研究和学习“python爬虫怎么实现下载豆瓣妹子图片”吧！
代码如下：
import requestsimport reimport timefrom bs4 import BeautifulSoup
cat =&＃39;2&＃39;img = &＃39;http://www.dbmeinv.com/dbgroup/show.htm?cid=&＃39;+ catend = &＃39;/dbgroup/show.htm?cid=&＃39;+ cat + &＃39;&pager_offset=100&＃39;urls = [ ]def getURLs(mainURL): time.sleep(1) headers = {&＃39;User-Agent&＃39;: &＃39;Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.2526.80 Safari/537.36&＃39;} html = requests.get(mainURL).text soup = BeautifulSoup(html, &＃39;html.parser&＃39;) picURL = re.findall(&＃39;![]()
for url in picURL: urls.append(url) print(url) asoup = soup.select(&＃39;.next a&＃39;)[0][&＃39;href&＃39;] Next_page = &＃39;http://www.dbmeinv.com&＃39; + asoup if asoup != end: getURLs(Next_page) else: print(&＃39;链接已处理完毕！&＃39;) return urlsurl = getURLs(img)
i = 0for each in url: pic = requests.get(each, timeout = 10) picName = &＃39;pictures/&＃39; + str(i) + &＃39;.jpg&＃39; fp = open(picName, &＃39;wb&＃39;) fp.write(pic.content) fp.close() i += 1
print(&＃39;图片下载完成&＃39;)
感谢各位的阅读，以上就是“python爬虫怎么实现下载豆瓣妹子图片”的内容了，经过本文的学习后，相信大家对python爬虫怎么实现下载豆瓣妹子图片这一问题有了更深刻的体会，具体使用情况还需要大家实践验证。这里是编程笔记，小编将为大家推送更多相关知识点的文章，欢迎关注！
京公网安备 11010802041100号