How do i index my test server.

silverfish · 03-29-2004, 12:12 PM

I want to index my localhost, which is just my ip right now, as it is a test server.

Ever time i try to index my IP, one level in.. It jsut indexes forever.. saying LOCKED over and over.. it never stops, and it isnt putting anything into the database.

If anyone has successfully indexed a folder in their localhost, please let me know how to do it!

Silver

Charter · 03-29-2004, 01:37 PM

Hi. Perhaps something in this thread might help.

silverfish · 03-29-2004, 01:39 PM

Hmm...

No... See im behind a firewall, but so is my server...So im just indexing locally...

It just says locked, but nothing is being written to the db, yet it loads and loads..

Charter · 03-29-2004, 01:50 PM

Hi. Is anything getting into the tempspider table?

silverfish · 03-29-2004, 01:51 PM

Ok..
i changed the 'USE_IS_EXECUTABLE_COMMAND' to 0 and it seemed to work in indexing..

But it wont spider.. it just indexed the first page, thats it..

Charter · 03-29-2004, 02:09 PM

Hi. What search depth are you using?

silverfish · 03-29-2004, 02:10 PM

It doesnt seem to matter...

I go from 1 all the way to 20 and it still only returns the first page.

Charter · 03-29-2004, 02:18 PM

Hi. Perhaps try the suggestions in this thread, and if there is a base href tag, then try the code in this post.

silverfish · 03-29-2004, 02:37 PM

Still only indexes the first page.

Charter · 03-29-2004, 02:47 PM

Hi. Try uncommenting //print $answer."<br>\n"; in robot_functions.php and see what you get on index.

silverfish · 03-29-2004, 02:50 PM

This is what i get when I spider:

Spidering in progress...

--------------------------------------------------------------------------------
SITE : http://webdev/
Exclude paths :
- @NONE@
1:http://webdev/mambo/
(time : 00:00:08)
No link in temporary table

--------------------------------------------------------------------------------

links found : 1
http://webdev/mambo/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

silverfish · 03-29-2004, 02:54 PM

If i can get this to work, I can post to the whole mambo community about this engine..

Charter · 03-29-2004, 03:01 PM

Hi. Doesn't Mambo already have PhpDig integrated? I thought it did, but maybe I'm just confused.

Anyway, what did you get when you uncommented //print $answer."<br>\n"; in the robot_functions.php file?

silverfish · 03-29-2004, 03:04 PM

Opps...

here is what I got:

HTTP/1.1 404 Not Found
HTTP/1.1 200 OK
Date: Mon, 29 Mar 2004 23:03:34 GMT
Server: Apache/1.3.29 (Win32)
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Expires: Mon, 26 Jul 1997 05:00:00 GMT
Pragma: no-cache
X-Powered-By: PHP/4.3.4
Set-Cookie: sessioncookie=3e3025a85c2bba6ea08f8512c863dc2c; expires=Tue, 30-Mar-2004 11:03:34 GMT; path=/
Set-Cookie: mosvisitor=1
Last-Modified: Mon, 29 Mar 2004 23:03:34 GMT
Content-Type: text/html

HTTP/1.1 200 OK
Date: Mon, 29 Mar 2004 23:03:35 GMT
Server: Apache/1.3.29 (Win32)
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Expires: Mon, 26 Jul 1997 05:00:00 GMT
Pragma: no-cache
X-Powered-By: PHP/4.3.4
Set-Cookie: sessioncookie=1ede113f1f6232445c38b9a20237c08f; expires=Tue, 30-Mar-2004 11:03:35 GMT; path=/
Set-Cookie: mosvisitor=1
Last-Modified: Mon, 29 Mar 2004 23:03:35 GMT
Content-Type: text/html

HTTP/1.1 404 Not Found

--------------------------------------------------------------------------------
SITE : http://webdev/
Exclude paths :
- @NONE@
HTTP/1.1 200 OK
Date: Mon, 29 Mar 2004 23:03:40 GMT
Server: Apache/1.3.29 (Win32)
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Expires: Mon, 26 Jul 1997 05:00:00 GMT
Pragma: no-cache
X-Powered-By: PHP/4.3.4
Set-Cookie: sessioncookie=1ffb0f6dac1a34f53e5f5b7da5899104; expires=Tue, 30-Mar-2004 11:03:40 GMT; path=/
Set-Cookie: mosvisitor=1
Last-Modified: Mon, 29 Mar 2004 23:03:40 GMT
Content-Type: text/html

1:http://webdev/mambo/
(time : 00:00:08)
No link in temporary table

--------------------------------------------------------------------------------

links found : 1
http://webdev/mambo/
Optimizing tables...
Indexing complete !
--------------------------------------------------------------------------------
[Back] to admin interface.

Charter · 03-29-2004, 03:23 PM

Hi. What happens when you add one of the following to your hosts file?

127.0.0.1 localhost
127.0.0.1 webdev/
127.0.0.1 webdev/mambo/

# or maybe this:

127.0.0.1 localhost
127.0.0.1 webdev.com/
127.0.0.1 webdev.com/mambo/

# or maybe this:

127.0.0.1 localhost
127.0.0.1 www.webdev.com/
127.0.0.1 www.webdev.com/mambo/

03-29-2004, 12:12 PM	#1
silverfish Green Mole Join Date: Mar 2004 Posts: 27	How do i index my test server. I want to index my localhost, which is just my ip right now, as it is a test server. Ever time i try to index my IP, one level in.. It jsut indexes forever.. saying LOCKED over and over.. it never stops, and it isnt putting anything into the database. If anyone has successfully indexed a folder in their localhost, please let me know how to do it! Silver

03-29-2004, 01:37 PM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Perhaps something in this thread might help. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

03-29-2004, 01:50 PM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Is anything getting into the tempspider table? __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

03-29-2004, 02:09 PM	#6
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. What search depth are you using? __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

03-29-2004, 02:18 PM	#8
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Perhaps try the suggestions in this thread, and if there is a base href tag, then try the code in this post. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

03-29-2004, 01:39 PM	#3
silverfish Green Mole Join Date: Mar 2004 Posts: 27	Hmm... No... See im behind a firewall, but so is my server...So im just indexing locally... It just says locked, but nothing is being written to the db, yet it loads and loads..

03-29-2004, 01:51 PM	#5
silverfish Green Mole Join Date: Mar 2004 Posts: 27	Ok.. i changed the 'USE_IS_EXECUTABLE_COMMAND' to 0 and it seemed to work in indexing.. But it wont spider.. it just indexed the first page, thats it..

03-29-2004, 02:10 PM	#7
silverfish Green Mole Join Date: Mar 2004 Posts: 27	It doesnt seem to matter... I go from 1 all the way to 20 and it still only returns the first page.

03-29-2004, 02:37 PM	#9
silverfish Green Mole Join Date: Mar 2004 Posts: 27	Still only indexes the first page.

03-29-2004, 02:47 PM	#10
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Try uncommenting //print $answer."<br>\n"; in robot_functions.php and see what you get on index. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

03-29-2004, 02:50 PM	#11
silverfish Green Mole Join Date: Mar 2004 Posts: 27	This is what i get when I spider: Spidering in progress... -------------------------------------------------------------------------------- SITE : http://webdev/ Exclude paths : - @NONE@ 1:http://webdev/mambo/ (time : 00:00:08) No link in temporary table -------------------------------------------------------------------------------- links found : 1 http://webdev/mambo/ Optimizing tables... Indexing complete ! -------------------------------------------------------------------------------- [Back] to admin interface.

03-29-2004, 02:54 PM	#12
silverfish Green Mole Join Date: Mar 2004 Posts: 27	If i can get this to work, I can post to the whole mambo community about this engine..

03-29-2004, 03:01 PM	#13
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Doesn't Mambo already have PhpDig integrated? I thought it did, but maybe I'm just confused. Anyway, what did you get when you uncommented //print $answer."<br>\n"; in the robot_functions.php file? __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

03-29-2004, 03:04 PM	#14
silverfish Green Mole Join Date: Mar 2004 Posts: 27	Opps... here is what I got: HTTP/1.1 404 Not Found HTTP/1.1 200 OK Date: Mon, 29 Mar 2004 23:03:34 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=3e3025a85c2bba6ea08f8512c863dc2c; expires=Tue, 30-Mar-2004 11:03:34 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Mon, 29 Mar 2004 23:03:34 GMT Content-Type: text/html HTTP/1.1 200 OK Date: Mon, 29 Mar 2004 23:03:35 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=1ede113f1f6232445c38b9a20237c08f; expires=Tue, 30-Mar-2004 11:03:35 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Mon, 29 Mar 2004 23:03:35 GMT Content-Type: text/html HTTP/1.1 404 Not Found -------------------------------------------------------------------------------- SITE : http://webdev/ Exclude paths : - @NONE@ HTTP/1.1 200 OK Date: Mon, 29 Mar 2004 23:03:40 GMT Server: Apache/1.3.29 (Win32) Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Mon, 26 Jul 1997 05:00:00 GMT Pragma: no-cache X-Powered-By: PHP/4.3.4 Set-Cookie: sessioncookie=1ffb0f6dac1a34f53e5f5b7da5899104; expires=Tue, 30-Mar-2004 11:03:40 GMT; path=/ Set-Cookie: mosvisitor=1 Last-Modified: Mon, 29 Mar 2004 23:03:40 GMT Content-Type: text/html 1:http://webdev/mambo/ (time : 00:00:08) No link in temporary table -------------------------------------------------------------------------------- links found : 1 http://webdev/mambo/ Optimizing tables... Indexing complete ! -------------------------------------------------------------------------------- [Back] to admin interface.

03-29-2004, 03:23 PM	#15
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. What happens when you add one of the following to your hosts file? 127.0.0.1 localhost 127.0.0.1 webdev/ 127.0.0.1 webdev/mambo/ # or maybe this: 127.0.0.1 localhost 127.0.0.1 webdev.com/ 127.0.0.1 webdev.com/mambo/ # or maybe this: 127.0.0.1 localhost 127.0.0.1 www.webdev.com/ 127.0.0.1 www.webdev.com/mambo/ __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
do not index directory listing on web server ?	ipguy	Troubleshooting	1	01-17-2006 12:56 PM
can phpdig index PDF server-side served from php?	Sybolt	How-to Forum	1	02-18-2005 01:16 PM
Test Server	RaGe	Mod Requests	0	05-10-2004 05:01 PM
Googlebot/Test	Charter	IPs, SEs, & UAs	4	04-30-2004 12:50 PM
Spider test for me	DrKamikaze83	Troubleshooting	23	02-28-2004 05:03 PM