links
 

Hello all

first excuse my bad english.

1/ I test phpdig (in french) and on results page I obtain links with the title of the file with "SansTitre" (WithoutTitle) at the end of every link.

for example :
I should have a link like : Tour de France
I have : Tour de FranceSansTitre

An idea to correct that ?

2/ Lot of files are indexed two times (.php)
example :
first time : tourdefrance.php
second time : tourdefrance.php?results=1
(it's the same file of course).

How to correct that for the next time ?

Thanks for advance.

No ideas on my problem ?

thanks

Hi. For one, what versions of PHP and PhpDig are you running?

For two, perhaps set the crawl level to one level in the config file by defining SPIDER_MAX_LIMIT, SPIDER_DEFAULT_LIMIT, and RESPIDER_LIMIT to be one and then do a crawl.

Alternatively, perhaps try using the PHPDIG_EXCLUDE_COMMENT and PHPDIG_INCLUDE_COMMENT values in the file to be crawled to exclude certain parts of the page.