PhpDig.net - View Single Post

vinyl-junkie · 04-26-2004, 06:11 AM

A few possibilities come to mind.

Do you have anything in your robots.txt that would prevent your site from being spidered?
What did you choose for a default search depth? If it was zero, phpDig may have just spidered the root and nothing else.
What is LIMIT_DAYS set to in your config.php file, and when is the last time you spidered your site? It's possible that phpDig won't let you re-spider because the requisite number of days have not passed since you last spidered.

If none of the above applies, consider posting your spider log, as there might be something there that would give us a clue.

04-26-2004, 06:11 AM	#3
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	A few possibilities come to mind. Do you have anything in your robots.txt that would prevent your site from being spidered? What did you choose for a default search depth? If it was zero, phpDig may have just spidered the root and nothing else. What is LIMIT_DAYS set to in your config.php file, and when is the last time you spidered your site? It's possible that phpDig won't let you re-spider because the requisite number of days have not passed since you last spidered. If none of the above applies, consider posting your spider log, as there might be something there that would give us a clue.