CouldnotopenCONNECTtunnelwithproxy错误异常捕获TunnelError

scrapy中间件middlewares中当我们使用代理爬取页面的时候&＃xff0c;提示如下错误&＃xff1a;

Could not open CONNECT tunnel with proxy 14.115.105.155:808 [{&＃39;status&＃39;: 307, &＃39;reason&＃39;: b&＃39;Temporary Redirect&＃39;}]

很有可能已加入对方黑名单&＃xff0c;可以用如下命令捕获异常&＃xff0c;并删除这个代理&＃xff1a;

from scrapy.core.downloader.handlers.http11 import TunnelErrorclass RandomProxyMiddleware(object):......def process_exception(self,request,exception,spider):if isinstance(exception,TunnelError)&＃xff1a;pass