Slow Response Time

[jmitchell]

I have indexed 60,000 pages, and all of a sudden when I do a search, response time is more then 2 seconds and at times around 9 seconds. Now, there is almost no load at all on this server, so that is not it, and I don't have any idea what it is.

any ideas anyone?

JMitchell

[Charter]

Perhaps the following threads may give ideas...

http://www.phpdig.net/forum/showthread.php?t=369
http://www.phpdig.net/forum/showthread.php?t=676
http://www.phpdig.net/forum/showthread.php?t=1726

[jmitchell]

can people give me some response times of their installations of phpdig, and how many pages indexed?

thanks

JMitchell

[Wayne McBryde]

DataBase status
Hosts : 1159 Entries
Pages : 29143 Entries
Index : 4477746 Entries
Keywords : 214936 Entries

Search Time
2005-02-09 14:32:46 florist 170 s 0.03
2005-02-09 13:58:53 riley''s 40 s 0.07
2005-02-09 13:58:41 riley\%27s 0 s 0
2005-02-09 13:41:59 rental yacht 80 s 0.22
2005-02-09 13:41:28 yachts 42 s 0.02
2005-02-09 12:23:05 estate real 3815 s 0.7
2005-02-09 12:01:45 jobs nanny 1 s 0.04
2005-02-09 11:19:15 city jobs 500 s 0.25
2005-02-09 10:17:44 historic homes 262 s 0.33
2005-02-09 07:33:38 0 s 0
2005-02-09 07:32:08 cms 27 s 0.02
2005-02-09 00:35:54 \%22jonathan foster\%22 0 s 0
2005-02-09 00:35:52 foster jonathan 11 s 0.08
2005-02-09 00:35:40 foster jonathan 11 s 0.04
2005-02-09 00:34:21 churches 536 s 0.07
2005-02-09 00:32:23 foster jonathan 11 s 0.04
2005-02-09 00:32:19 \%22jonathan foster\%22 0 s 0
2005-02-09 00:20:49 doubledoorinn 0 s 0
2005-02-08 21:03:52 help wanted 375 s 0.37
2005-02-08 17:56:12 internet public 472 s 0.33
2005-02-08 17:54:45 access internet public 211 s 0.55
2005-02-08 17:42:26 wireless 93 s 0.03
2005-02-08 17:38:00 wireless 93 s 0.03
2005-02-08 17:07:44 lkn signs 8 s 0.08
2005-02-08 14:27:48 catawba queen 95 s 0.16
2005-02-08 12:05:07 canoe rental 11 s 0.15
2005-02-08 11:02:02 subdivisions 44 s 0.03
2005-02-08 10:48:14 retaurants 0 s 0
2005-02-08 10:48:12 food 1207 s 0.1
2005-02-08 10:48:10 breakfast 380 s 0.05


Server has a 1.2 Ghz processor, 1.2G RAM and a medium load. Server colocated very near Internet backbone in Charlotte, NC.

What type internet connection does your server have? Does the website run slower than before?

[Dave A]

I'm just upgrading my hosting to a Dell Rack mount 3.2 Gig processor, 512 mb ram and 64gb hard disk.
The spidering times vary heaps a few hosts I have tried to spider were home PC's connected via ADSL broadband and it took an age to index them.
One guy complained and said the spider wasn't well behaved and it was doing a get command every one second which he thought was too much.
How you can expect a commercial web site to run from a home computer I am not sure if it would work.

[jmitchell]

this server doesn't have a load at all at this time, and the website loads fast enough, its just when I do a search that it slows waaaayy down.

JMitchell

[Dave A]

Hi I am not sure if this is of any help but have you cleared the common words, cleaned the dictionary and the index? Becuse my Php appears to slow down if it's not kept really clean and tempory files appears to almost grind it to a halt.
In the stats pages some searches have exeeded forty seconds but they are when someone does an EXACT search, so exact searches take longer.
Not forgetting that in my area of the world it is sometimes easier and quicker to place the bytes into a bucket and drive to the server. Telecoms Broadband isn't very wide.

[jmitchell]

I cleaned the dictionary and the index and its still as slow as before. I'm still using the default "AND" search mode.

As for going there, server is 2000 miles away, so thats pretty much out of the question.

JMitchell