|
08-04-2004, 11:15 AM | #1 | |
Green Mole
Join Date: Aug 2004
Posts: 1
|
Making Search Spider Follow Links?
I was wondering how you make search spiders keep on following links. My spider is in php. Here is what I have so far:
Quote:
|
|
08-08-2004, 05:22 PM | #2 |
Head Mole
Join Date: May 2003
Posts: 2,539
|
Hi. Maybe just download PhpDig and have a look at the code?
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension. |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
problems making phpdig able to search pdf files | butterivenne | Script Installation | 1 | 07-29-2008 01:26 PM |
spider ignores links | Maarten Wijnen | Troubleshooting | 2 | 03-17-2005 02:23 PM |
Will not follow links | td234 | Troubleshooting | 2 | 01-27-2005 05:37 AM |
spider.php will NOT follow link | barik | Troubleshooting | 0 | 10-23-2004 06:07 PM |
Relative links to follow in meta-refresh and Javascript | obottek | Mod Requests | 4 | 10-05-2003 10:20 AM |