Hi. The temporary table should probably not be growing like that. The spider.php file has the following code:
PHP Code:
// clean the tempspider table
$query = "DELETE FROM ".PHPDIG_DB_PREFIX."tempspider WHERE site_id=$site_id AND (error = 1 OR indexed = 1)";
mysql_query($query,$id_connect);
Can you post the first few entries from the table? What versions of PHP and PhpDig are you using?