Speed up phpdig?
Hi,
The most time of indexing is getting urls from the file. Am I right *looking at plus signs*?
I guess, phpdig could work more quickly, if we seperate processing of indexing:
1. Gettings urls from pages
2. Indexing page
In temp table or on the disk we could save temporary files of indexing pages for second process or not save at all. So, if you changed contents but not links you could simply reindex pages more faster.
What you think?
|