PHPCrawl

代码说明：

  使用PHP脚本编写的一个网络爬虫，用来抓取对应网站的一些基本信息。(A web crawler using PHP scripting to grab some basic information of the corresponding website.)

文件列表：

PHPCrawl
........\CHANGELOG.txt,3719,2007-01-05
........\classes
........\.......\phpcrawler.class.php,26558,2007-01-03
........\.......\phpcrawlerpagerequest.class.php,17942,2007-01-03
........\.......\phpcrawlerrobotstxthandler.class.php,9441,2007-01-03
........\.......\phpcrawlerutils.class.php,28389,2007-01-03
........\documentation
........\.............\classreference.html,43471,2007-01-05
........\.............\download.html,2003,2007-01-05
........\.............\example.html,7241,2007-01-05
........\.............\img


........\.............\index.html,2711,2007-01-05
........\.............\quickstart.html,2844,2007-01-05
........\.............\style.css,2673,2007-01-05
........\.............\testinterface.html,3016,2007-01-05
........\.............\version_info.html,8199,2007-01-05
........\example.php,2720,2013-04-07
........\LICENSE.txt,15493,2006-08-12
........\test_interface
........\..............\index.php,28772,2007-01-05
........\..............\info.gif
........\..............\js.js,2708,2007-01-03
........\..............\output.php,4029,2007-01-05
........\..............\phpcrawlsetup.class.php,15808,2006-12-18
........\..............\phpcrawl_testinterface.conf.php,825,2007-01-05
........\..............\phpcrawl_testinterface.func.php,3382,2007-01-06
........\..............\setups
........\..............\......\Example_Setup.psf,2776,2007-01-05
........\..............\style.css,746,2007-01-03