[导读]:[10/Apr/2014:04:39:24 +0800] "GET / HTTP/1.0" 301 38739 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"118.123.249.53 [10/Apr/2014:08:35:20 +0800] "GET / HTTP/1.0" 200 10150 "-" "Mozilla/5...
[10/Apr/2014:04:39:24 +0800] "GET / HTTP/1.0" 301 38739 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"118.123.249.53
[10/Apr/2014:08:35:20 +0800] "GET / HTTP/1.0" 200 10150 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"118.123.249.53
这两个分别是什么意思,而且看到更新的文章蜘蛛有爬,但没有被收录,文章原创的。
楼主,这两个是伪蜘蛛。所以爬过不收录。
本文来自投稿,不代表微盟圈立场,如若转载,请注明出处:https://www.vm7.com/a/ask/23704.html