Thread: Embedding phpdig into a forum
View Single Post
Old 06-22-2004, 11:46 PM   #7
bloodjelly
Purple Mole
 
Join Date: Dec 2003
Posts: 106
Robots.txt is exclusionary (at least right now) - that is, you tell it which folders NOT to scan. Search google to learn how to use it or check the link I posted.
bloodjelly is offline   Reply With Quote