scrapy框架之代理的使用

首先我们检测ip是否可用:

1.对于免费代理的检测

#免费代理或不用密码的代理 url = \'\' proxy = \'127.0.0.0:8000\' proxies = { \'http\': \'\' + proxy, \'https\': \'https://\' + proxy, } response = requests.get(url, proxies=proxies, verify=False) print(response.text)