How to limit indexing to a specific directory?

Beans · 08-14-2005, 02:21 PM

My goal is a topic specific search engine.. many web resources for this topic are scattered across the web on various servers.. some deticated, some not.

For instance, let's say i'm running a search engine just for information about golf balls.

A website like "www.justgolfballs.com" might have information contained in the directory /information and sales stuff in a directory called /sales

I don't want to include the /sales directory in my indexing, because if somebody searches for "good balls" I want them to see information, not a sales pitch.

Now a website like "www.justgolfballinformation.com" might contain nothing but golf ball information.. so this is a site i'd like to search all of.

So how do I limit my indexed pages to a specific directory for certian domains?

Charter · 08-15-2005, 11:03 AM

Look for LIMIT_TO_DIRECTORY in the config file, set it to true, and then index. Check out this thread too.

08-14-2005, 02:21 PM	#1
Beans Green Mole Join Date: Jul 2005 Posts: 3	How to limit indexing to a specific directory? My goal is a topic specific search engine.. many web resources for this topic are scattered across the web on various servers.. some deticated, some not. For instance, let's say i'm running a search engine just for information about golf balls. A website like "www.justgolfballs.com" might have information contained in the directory /information and sales stuff in a directory called /sales I don't want to include the /sales directory in my indexing, because if somebody searches for "good balls" I want them to see information, not a sales pitch. Now a website like "www.justgolfballinformation.com" might contain nothing but golf ball information.. so this is a site i'd like to search all of. So how do I limit my indexed pages to a specific directory for certian domains?

08-15-2005, 11:03 AM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Look for LIMIT_TO_DIRECTORY in the config file, set it to true, and then index. Check out this thread too. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Search in specific directory	laurentxav	How-to Forum	7	01-04-2005 09:34 AM
Specific Directory Search	kh44na	How-to Forum	3	04-01-2004 05:52 AM
Search in specific directory	tams	Troubleshooting	1	03-15-2004 03:08 AM
exclude specific directory from searching	rasputin	How-to Forum	1	01-29-2004 08:02 PM
Search in specific directory ONLY?	mrfuches	How-to Forum	6	01-23-2004 12:06 AM