|
01-08-2005, 01:03 PM | #1 |
Purple Mole
Join Date: Aug 2004
Location: North Island New Zealand
Posts: 170
|
Does the robot?
I have been using phpdig for ages and yesterday someone asked me if the robot was able to follow Java links within web sites?
It seems to follow just about anything (Grin) but I don't really know the answer, so I informed the person who asked the question that I would find out! So can any one let me know if the robot will find and follow java links. I think that it can but I want to be sure I don't lead them astray. Many regards Dave A |
01-08-2005, 09:03 PM | #2 |
Purple Mole
Join Date: Jan 2004
Posts: 694
|
It's not in the list of forbidden extensions in the config file, so I don't know why phpdig wouldn't index a java link. You can easily establish whether phpdig will or won't index a java link by trying to index just one page. For example, this one:
http://www.java.com/en/index.jsp |
01-08-2005, 09:28 PM | #3 |
Purple Mole
Join Date: Aug 2004
Location: North Island New Zealand
Posts: 170
|
Hi Pat,
yes it does index Java. Many thanks for you help once more. |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Problem with robot.txt file | Samar | Troubleshooting | 1 | 02-09-2006 11:29 AM |