PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   How-to Forum (http://www.phpdig.net/forum/forumdisplay.php?f=33)
-   -   How to index only local directory files? (http://www.phpdig.net/forum/showthread.php?t=1784)

sf44 01-28-2005 02:56 AM

How to index only local directory files?
 
I have prepared all files I need to index in special directory.
Is there any possibility to setup spider to index only this special directory files?
I am possible to add all file names to database - tempspider table.

Why to do this? Because spidering many special selected files using external urls but also http://localhost is too slow - it is about 15s for one page. I have changed everything to boost spidering proces, but all I have done is decreasing time from 20s to 15s for one page - it's still too much time.


All times are GMT -8. The time now is 10:43 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.