I'm trying to spider a site I'm typing in the site
http://www.mysite.com/subdir/
I want it to go through everything, not just subdir/ but it never finds any links follow. Is there a debug mode to watch what the spider is doing?
I have also edited the config file:
PHP Code:
define('LIMIT_TO_DIRECTORY',false);