继续请教 scrapy 问题为什么蜘蛛会得到 404 状态而浏览器打开正常

V2EX = way to explore

V2EX 是一个关于分享和探索的地方

For Existing Member Sign In

This topic created in 3537 days ago, the information mentioned may be changed or developed.

2016-08-19 19:39:48 [scrapy] DEBUG: Crawled (404) <GET <a="" href="<a href=" http:="" www.xiumm.cc="" albums="" Goddess-2.html"="" rel="nofollow">http://www.xiumm.cc/albums/Goddess-2.html" rel="nofollow">http://www.xiumm.cc/albums/Goddess-2.html> (referer: None) 2016-08-19 19:39:48 [scrapy] DEBUG: Crawled (404) <GET <a="" href="<a href=" http:="" www.xiumm.cc="" albums="" Goddess-3.html"="" rel="nofollow">http://www.xiumm.cc/albums/Goddess-3.html" rel="nofollow">http://www.xiumm.cc/albums/Goddess-3.html> (referer: None)

http://www.xiumm.cc/albums/TuiGirl-5.html 目标站

求教高手看看那

No Comments Yet

Scrapy 2016-08-19 19:39:48 crawled

继续请教 scrapy 问题 为什么蜘蛛会得到 404 状态而浏览器打开正常

继续请教 scrapy 问题为什么蜘蛛会得到 404 状态而浏览器打开正常