*please help*: crawling search sites -howto make a metasearcher

nicozab · 06-30-2006, 11:49 PM

I wonder if phpdig can do this..
i need to make a meta-search site for the gardening industry. for this I need to crawl 8 or 9 related sites and present the results in a unified view and page. i'll need:

1. to take the search keyword -introduced by the user-,

2. look into each one of this directories/sites (with different layouts and ia) and execute a search

3. take the results with its comments, hyperlinks and any related information

4. show'em in a unified list

can i do this? any related information? code? tip?
thanks in advance, i really need to make this *soon*. any help wil be greatly appreciated.

.nicozab.

M_Saint · 07-04-2006, 05:04 PM

You could do that with phpdig very easily.
Read the documentation and pay attention to the config.php file.

06-30-2006, 11:49 PM	#1
nicozab Green Mole Join Date: Jun 2006 Posts: 1	please help: crawling search sites -howto make a metasearcher I wonder if phpdig can do this.. i need to make a meta-search site for the gardening industry. for this I need to crawl 8 or 9 related sites and present the results in a unified view and page. i'll need: 1. to take the search keyword -introduced by the user-, 2. look into each one of this directories/sites (with different layouts and ia) and execute a search 3. take the results with its comments, hyperlinks and any related information 4. show'em in a unified list can i do this? any related information? code? tip? thanks in advance, i really need to make this soon. any help wil be greatly appreciated. .nicozab.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Exlude sites from Search	Surffritze	Troubleshooting	4	10-05-2004 05:44 AM
search form sites	guskoul	Troubleshooting	7	08-03-2004 01:55 PM
How to search all sites at once?	digitalje5u5	How-to Forum	2	08-03-2004 05:57 AM
crawling of only internal links?	manute	Troubleshooting	1	06-19-2004 06:38 AM
Crawling Options	jimigisme	How-to Forum	12	09-30-2003 11:09 AM

07-04-2006, 05:04 PM	#2
M_Saint Green Mole Join Date: Jun 2006 Posts: 3	You could do that with phpdig very easily. Read the documentation and pay attention to the config.php file.