Can PhpDig spider only certain sites?

jkuzma · 02-11-2005, 01:19 PM

Lets say I want to create a search engine specific to GOLF. Is it possible for PhpDig to spider only golf related websites?

Also, how robust is the software? Will it handle mega-traffic?

Charter · 02-11-2005, 03:38 PM

PhpDig attempts to spider whatever you give it, so if you want a golf based search engine, then just feed PhpDig golf based links. For the latter questions, maybe join this discussion.

02-11-2005, 01:19 PM	#1
jkuzma Green Mole Join Date: Feb 2005 Posts: 1	Can PhpDig spider only certain sites? Lets say I want to create a search engine specific to GOLF. Is it possible for PhpDig to spider only golf related websites? Also, how robust is the software? Will it handle mega-traffic?

02-11-2005, 03:38 PM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	PhpDig attempts to spider whatever you give it, so if you want a golf based search engine, then just feed PhpDig golf based links. For the latter questions, maybe join this discussion. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
PHPDig won't index most sites and only go down one level on all	confusion	Troubleshooting	1	10-14-2005 11:32 AM
custom sites phpdig:form_dropdown	jdell_nv	How-to Forum	5	04-07-2005 03:19 PM
"I don't want to index your sites!!!" - said PHPDig	#ASH	How-to Forum	1	04-06-2005 02:57 PM
Command Line Spider spiders all sites	Wayne McBryde	Troubleshooting	3	01-27-2004 06:15 PM