Locked Site

olivier · 02-11-2005, 02:24 AM

Hello,

I installed phpdig this week and the index is working well for many sites.

I have a problem with one site. It is a TikiWiki.

PHPDig index only the first page and it seems that this site is locked very quickly.

- I am using the spider from the shell, so it is not a problem of timeout from my browser.
- I tried to remove the "locked" in the administration pannel for this site without effect. The site become locked when the spider start (which seems normal) but then stick to locked.
- I tried also to browse this site from my server with lynx without problem.

Do you have any ideas?

Here is the log from my spyder.log file:

*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
+ *http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*

*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
+2:http://test.toto.net/tikiwiki/tiki-u...view_user=test
(time : 00:00:45)
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
+ *http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*
*http://test.toto.net/ Locked*

Thanks,
Olivier.

Charter · 02-11-2005, 06:09 AM

A site gets locked at the start of an index and then gets unlocked at the successful end of an index. A site could already be locked before the start of an index if the spider ended prematurely the last time. Try running stop spider and then unlock the site.

olivier · 02-11-2005, 06:48 AM

Thanks Charter.

Yes, I read this before on some other thread yesterday.

This site was unlocked before the spider start. But it was not working...

But this morning, it seems to work perfectly!

I don't understand what has happened yesterday night. Perhaps the site was too slow for the spider?? Is it possible?

Olivier.

Charter · 02-11-2005, 07:21 AM

Hmm, I'm not sure what happened. Glad it's working now.

02-11-2005, 02:24 AM	#1
olivier Green Mole Join Date: Dec 2004 Posts: 17	Locked Site Hello, I installed phpdig this week and the index is working well for many sites. I have a problem with one site. It is a TikiWiki. PHPDig index only the first page and it seems that this site is locked very quickly. - I am using the spider from the shell, so it is not a problem of timeout from my browser. - I tried to remove the "locked" in the administration pannel for this site without effect. The site become locked when the spider start (which seems normal) but then stick to locked. - I tried also to browse this site from my server with lynx without problem. Do you have any ideas? Here is the log from my spyder.log file: http://test.toto.net/ Locked http://test.toto.net/ Locked + http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked +2:http://test.toto.net/tikiwiki/tiki-u...view_user=test (time : 00:00:45) http://test.toto.net/ Locked http://test.toto.net/ Locked + http://test.toto.net/ Locked http://test.toto.net/ Locked http://test.toto.net/ Locked Thanks, Olivier.

02-11-2005, 06:09 AM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	A site gets locked at the start of an index and then gets unlocked at the successful end of an index. A site could already be locked before the start of an index if the spider ended prematurely the last time. Try running stop spider and then unlock the site. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

02-11-2005, 07:21 AM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hmm, I'm not sure what happened. Glad it's working now. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Imcomplete spider : locked site but nothing append	beausej	Troubleshooting	1	07-18-2005 04:48 PM
Spidering Stops, Site is Locked after 7 Pages	nevsie	Troubleshooting	3	03-02-2005 04:52 PM
Locked	xiodaos	How-to Forum	1	06-14-2004 01:13 PM
locked site and commandlineinterface	baskamer	How-to Forum	1	02-05-2004 09:03 AM
Indexing always stops with locked site	jamie	Troubleshooting	3	01-06-2004 11:29 AM

02-11-2005, 06:48 AM	#3
olivier Green Mole Join Date: Dec 2004 Posts: 17	Thanks Charter. Yes, I read this before on some other thread yesterday. This site was unlocked before the spider start. But it was not working... But this morning, it seems to work perfectly! I don't understand what has happened yesterday night. Perhaps the site was too slow for the spider?? Is it possible? Olivier.