楼(lóu )上说(shuō )的很(hěn )多(duō ),我补(bǔ )充一下,正(zhèng )确的应该(gāi )叫网络蜘蛛(zhū ),又称爬(pá )虫,本质(zhì )是(shì )搜(sōu )索引(yǐn )擎(qíng )派出的一个(gè )执行抓取任务的程(chéng )序蜘蛛池的本质是(shì )大量的网站(zhàn )互相(xiàng )链接(jiē ),每个(gè )站单独产生(shēng )大(dà )量的内容吸引蜘蛛来爬(pá ),几千(qiān )个网站互链时(shí ),可以(yǐ )想象(xiàng )蜘蛛的链接
Copyright © 2008-2018