PhpDig.net - View Single Post

merrittholmes · 09-13-2004, 02:48 AM

Hi,

Thanks for the reply. In answer to your questions.

I have tried a few URLs. One internal (http://www.expw.co.uk), and also http://www.expw.co.uk/newsite/myweb/...lting.php?id=1 and also one external (http://www.chaplinspantos.co.uk). Each time I add the URL on the admin page and then choose dig It (I have tried a variety of depth options too) it just comes up with the 'Page cannot be displayed' page when it automatically tries to call spider.php . I haev checked the permissions on the file (777) and also that it is not corrupt (i have opened it in a text editor).

I have also tried calling the spider.php script directly in the URL box.

There is no exclusions in Robots.txt

It seems to be picked up if I copy it to the directory below (but then obviously I get lots of errors). I have checked the permissions of both file and directory.

Any help would be great. I'm happy to send screenshots if needed.

09-13-2004, 02:48 AM	#3
merrittholmes Green Mole Join Date: Sep 2004 Posts: 3	spidering page not found Hi, Thanks for the reply. In answer to your questions. I have tried a few URLs. One internal (http://www.expw.co.uk), and also http://www.expw.co.uk/newsite/myweb/...lting.php?id=1 and also one external (http://www.chaplinspantos.co.uk). Each time I add the URL on the admin page and then choose dig It (I have tried a variety of depth options too) it just comes up with the 'Page cannot be displayed' page when it automatically tries to call spider.php . I haev checked the permissions on the file (777) and also that it is not corrupt (i have opened it in a text editor). I have also tried calling the spider.php script directly in the URL box. There is no exclusions in Robots.txt It seems to be picked up if I copy it to the directory below (but then obviously I get lots of errors). I have checked the permissions of both file and directory. Any help would be great. I'm happy to send screenshots if needed.