"Update One Page" Updating The Whole Database

vinyl-junkie · 08-08-2004, 10:11 AM

I made some changes to one page on my website today, so I went through the procedure to re-index just the one page.

From the admin page, I clicked on the website link, then Update Form. From there I clicked on the right arrow to get a list of files that are indexed for that site. I found the file I wanted to update, and clicked the green check mark beside it, which should just re-index that one page. The spider is currently crawling the whole site, not just the one page!

Charter · 08-08-2004, 12:04 PM

Hi. I'm not sure this classifies as a bug or rather unexpected behavior.

If you change one page, should the spider just index that one page but not follow links, even if the links changed? I guess I can see it both ways. Maybe it should only reindex the one page regardless of links.

Anyway, if you want to crawl just one page, type the URI in the text box and set search depth to zero and links per to one from the main page of the admin panel.

If search depth and/or links per are not set, such as in the admin panel subpages or from shell, then the following constants are considered:

PHP Code:


			
define('SPIDER_MAX_LIMIT',20);

define('RESPIDER_LIMIT',5);

define('LINKS_MAX_LIMIT',20);

define('RELINKS_LIMIT',5);

If there is no 'Links' value set for the site on the 'Update sites' page of the admin control panel, these could be set to zero, zero, one, one respectively to only crawl one page.

If there is a 'Links' value set for the site on the 'Update sites' page of the admin control panel, and that value is one, these could be set to zero, zero, whatever, whatever respectively to only crawl one page.

If you want to stop the spider in a nice way, open a new browser and keep clicking the delete button, without selecting a site, until the spider stops. Once the tempspider table stays empty, the spider should stop.

vinyl-junkie · 08-08-2004, 02:23 PM

The first thing you suggested, selecting a search depth of zero, and links-per to one, did just what I wanted it to do - index just the one page without trying to crawl anything else.

Always wanting to play devil's advocate (and maybe this doesn't work exactly the same way), I changed the config.php file as you suggested, then went through my original process to get to the one page to index. That still tried to crawl the whole site, so I don't think that would work. I don't have shell access so I can't try it that way.

A somewhat related question though - When I get the right arrow to get the list of indexed pages, will click the red "x" beside one of those pages exclude it from future indexing?

Incidentally, the reason I posted this whole thing under the Bug Tracker sub-forum is that under 1.8.0 (if I'm remembering the correct version number of phpdig), you didn't have to do anything special to index just one page. Maybe the reason for the change is because we have a links-per selection now, where 1.8.0 didn't have that?

Charter · 08-08-2004, 05:02 PM

>> Always wanting to play devil's advocate (and maybe this doesn't work exactly the same way), I changed the config.php file as you suggested, then...

Hi, you need to make sure 'Links' is set to one for that site on the 'Update sites' page of the admin panel.

>> When I get the right arrow to get the list of indexed pages, will click the red "x" beside one of those pages exclude it from future indexing?

No, it just deletes it.

>> Maybe the reason for the change is because we have a links-per selection now, where 1.8.0 didn't have that?

Yes, things got changed.

08-08-2004, 10:11 AM	#1
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	"Update One Page" Updating The Whole Database I made some changes to one page on my website today, so I went through the procedure to re-index just the one page. From the admin page, I clicked on the website link, then Update Form. From there I clicked on the right arrow to get a list of files that are indexed for that site. I found the file I wanted to update, and clicked the green check mark beside it, which should just re-index that one page. The spider is currently crawling the whole site, not just the one page!

08-08-2004, 12:04 PM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. I'm not sure this classifies as a bug or rather unexpected behavior. If you change one page, should the spider just index that one page but not follow links, even if the links changed? I guess I can see it both ways. Maybe it should only reindex the one page regardless of links. Anyway, if you want to crawl just one page, type the URI in the text box and set search depth to zero and links per to one from the main page of the admin panel. If search depth and/or links per are not set, such as in the admin panel subpages or from shell, then the following constants are considered: PHP Code: `define('SPIDER_MAX_LIMIT',20); define('RESPIDER_LIMIT',5); define('LINKS_MAX_LIMIT',20); define('RELINKS_LIMIT',5);` If there is no 'Links' value set for the site on the 'Update sites' page of the admin control panel, these could be set to zero, zero, one, one respectively to only crawl one page. If there is a 'Links' value set for the site on the 'Update sites' page of the admin control panel, and that value is one, these could be set to zero, zero, whatever, whatever respectively to only crawl one page. If you want to stop the spider in a nice way, open a new browser and keep clicking the delete button, without selecting a site, until the spider stops. Once the tempspider table stays empty, the spider should stop. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

08-08-2004, 05:02 PM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	>> Always wanting to play devil's advocate (and maybe this doesn't work exactly the same way), I changed the config.php file as you suggested, then... Hi, you need to make sure 'Links' is set to one for that site on the 'Update sites' page of the admin panel. >> When I get the right arrow to get the list of indexed pages, will click the red "x" beside one of those pages exclude it from future indexing? No, it just deletes it. >> Maybe the reason for the change is because we have a links-per selection now, where 1.8.0 didn't have that? Yes, things got changed. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
shows blank page if "Search All" and "exact phrase", timeout?	alokjain9	Troubleshooting	2	03-07-2006 08:08 AM
Re-indexing a page, "boosting" pages	Kozz	How-to Forum	2	04-06-2005 02:32 PM
"1 1" between page header and search result	jensb	Troubleshooting	2	01-13-2005 02:37 PM
"search depth" and "links per" features	laurentxav	How-to Forum	1	01-12-2005 08:27 PM
"limit to" option on from page?	atticus1214	How-to Forum	3	03-03-2004 02:05 PM

08-08-2004, 02:23 PM	#3
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	The first thing you suggested, selecting a search depth of zero, and links-per to one, did just what I wanted it to do - index just the one page without trying to crawl anything else. Always wanting to play devil's advocate (and maybe this doesn't work exactly the same way), I changed the config.php file as you suggested, then went through my original process to get to the one page to index. That still tried to crawl the whole site, so I don't think that would work. I don't have shell access so I can't try it that way. A somewhat related question though - When I get the right arrow to get the list of indexed pages, will click the red "x" beside one of those pages exclude it from future indexing? Incidentally, the reason I posted this whole thing under the Bug Tracker sub-forum is that under 1.8.0 (if I'm remembering the correct version number of phpdig), you didn't have to do anything special to index just one page. Maybe the reason for the change is because we have a links-per selection now, where 1.8.0 didn't have that?