|
10-23-2004, 07:07 PM | #1 |
Green Mole
Join Date: Oct 2004
Posts: 1
|
spider.php will NOT follow link
I can't figure out the criteria which spider.php uses to decide whether to follow a link. Please take a look at:
http://www.barik.net/archive/ Every link is found except for all of the months! (Jan, Feb, Mar, etc.)! Can anyone shed some light on why this is? Did I forget to turn on an option? Does spider.php not look at links if they are formed a particular way? Any help is appreciated, Titus Barik |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
I have one bug with spider.php | Booboo | Troubleshooting | 1 | 03-01-2005 02:46 AM |
it founds all the link but does not follow them all | Fking | Troubleshooting | 2 | 10-06-2004 09:19 AM |
Making Search Spider Follow Links? | demo | Coding & Tutorials | 1 | 08-08-2004 06:22 PM |
don't follow link | Onno | How-to Forum | 1 | 03-05-2004 10:45 AM |
spider.php via bash | tomas | Troubleshooting | 16 | 02-07-2004 05:23 PM |