Thread: External link
View Single Post
Old 09-12-2004, 10:00 PM   #2
vinyl-junkie
Purple Mole
 
Join Date: Jan 2004
Posts: 694
Hi, pirw3t, and welcome to the forum!

If phpdig were setup to spider external links the way you are describing, you could end up spidering the entire internet. Not to mention the bandwidth you'd eat up on those other sites. You'd be better off spidering those other sites individually.
vinyl-junkie is offline   Reply With Quote