The ultimate phpdig

ezytrak · 04-01-2005, 12:08 AM

Hi everyone, have been working on Phpdig for around 2 months now and have added a completely new look to interface.

1. Front end has been turned into a key word selection process written completely in perl. Whereby you enter a key word and it will scrape 1000 results from google or whatever search engine , you then have the option to view site whereby it will then give you the option 2 enter into your phpdig database or move onto next result, this enters all the same results as per your normal phpdig admin interface.

ADMIN EDIT: Google's terms of service do not allow for "automated queries of any sort to Google's system without express permission in advance from Google." Other search engines may also have similar terms. Do not use PhpDig on a site without strictly abiding by such things as terms of service.

2. Currently have been adding approximately 300 sites per hour on this process dependant on access speed. Getting it to add direct into database was interesting it was like unbaking a cake.

3. Automatic updates - This is the cool part my database will update all sites that need to, every 14days, this has been written in perl with a exe file that sits on my local desktop - no need for cron.

4. Will have a demo area available in around a weeks time for anyone that is interested.

04-01-2005, 12:08 AM	#1
ezytrak Green Mole Join Date: Feb 2005 Posts: 4	The ultimate phpdig Hi everyone, have been working on Phpdig for around 2 months now and have added a completely new look to interface. 1. Front end has been turned into a key word selection process written completely in perl. Whereby you enter a key word and it will scrape 1000 results from google or whatever search engine , you then have the option to view site whereby it will then give you the option 2 enter into your phpdig database or move onto next result, this enters all the same results as per your normal phpdig admin interface. ADMIN EDIT: Google's terms of service do not allow for "automated queries of any sort to Google's system without express permission in advance from Google." Other search engines may also have similar terms. Do not use PhpDig on a site without strictly abiding by such things as terms of service. 2. Currently have been adding approximately 300 sites per hour on this process dependant on access speed. Getting it to add direct into database was interesting it was like unbaking a cake. 3. Automatic updates - This is the cool part my database will update all sites that need to, every 14days, this has been written in perl with a exe file that sits on my local desktop - no need for cron. 4. Will have a demo area available in around a weeks time for anyone that is interested.