PhpDig.net - View Single Post

xibalba · 03-11-2004, 06:33 PM

Does anyone know how to make PhPDig only crawl one domain? I initially started PHPDig like such

%php -f spider.php example.com

and now the crawler has more than 300 hosts in the database. I only want it to crawl example.com and store the information on that one paticular domain.

03-11-2004, 06:33 PM	#1
xibalba Green Mole Join Date: Mar 2004 Posts: 9	one domain Does anyone know how to make PhPDig only crawl one domain? I initially started PHPDig like such %php -f spider.php example.com and now the crawler has more than 300 hosts in the database. I only want it to crawl example.com and store the information on that one paticular domain.