View Full Version : automated search engine request interface

01-07-2003, 04:50 PM
hi there

can somebody tell me how i can make a webcrawler on my website wich is able to start requests on other search engines, for example with google.

how it should work:
i have a search function on my website. if somebody use this search funktion, my website should go to google (or other search engines) and asks there for the search kriteria. it should be able to check trough all the sites wich google is providing for this search criteria. then it should show the results from google, but in a better organized way then google does.

i think it should work something like this:
1. a ....... script or program should ask the google for the search kriteria.
2. a ....... script or program (i could imagine a perl script) sorts all the search results of google for a more precisious result.

i think for no. 2 i have to find a solution with perl. because i heard, that perl is very vamouse in searching text documents.
but i have no idea how to solve the problem no.1. i was thinking to solve this task with something like a C++ applikation wich is running on a small server, but maybee it would work better with a solution of a cgi script or php wich is running on a webserver or somethin like this???
so, my problem is that i don't know enough about the possibilitys of the programming an scripting things. if there is a person who can give me a little input how to solve this tasks as easy as possible i would be verry happy.

thanks bluechip

01-07-2003, 05:22 PM
Almost very searchengine allows you to put some code on your site for your visitors to search the web..
Google: http://www.google.com/services/index.html
All The Web: http://www.alltheweb.com/help/webmaster/add_to_site.html

01-07-2003, 10:35 PM
to: MCookie
thanks, for your posting. but, unvortunately your answer is not verry helpfull for me.

if anyone has an answer to my question please tell me.

best wishes bluechip

01-07-2003, 11:13 PM
Well Bluechip, yes, I know my answer doesn't really help but I don't think there's a way to take some Perl script and "better organize Google's search results". I mean, really...

01-08-2003, 12:39 AM
well, my friend;-)

see, my problem is not the perl script. my proble is, how to make a interface wich can inquire the google. i don't know if i have to take a winnt-box wich is running a self made c++ application, or if i can simply solve this problem with a cgi script on the webserver, or if i have to ask one of this php-mysql-guys :confused:

so, if you could give me some infos to solve this problem, that would be verry helpfull for me.

best wishes an a happy new-year :thumbsup:


ps:in wich city do you live, perhaps we are neighbours:D

01-12-2003, 04:39 AM
Develop Your Own Applications Using Google: http://www.google.com/apis/

Neighbours? http://www.google.com/search?hl=en&ie=ISO-8859-1&q=Harderwijk&btnG=Google+Search

01-21-2003, 12:16 PM
mebbe diz helps...

that doesn't re-arrange things cauz is trademark infringement or copyright violation or wtf, I dun mess with that.
you're prolly gonna have to bog down in da dirt 'n code sum perl. dunno...