bluechip
01-07-2003, 03:50 PM
hi there
can somebody tell me how i can make a webcrawler on my website wich is able to start requests on other search engines, for example with google.
how it should work:
i have a search function on my website. if somebody use this search funktion, my website should go to google (or other search engines) and asks there for the search kriteria. it should be able to check trough all the sites wich google is providing for this search criteria. then it should show the results from google, but in a better organized way then google does.
i think it should work something like this:
1. a ....... script or program should ask the google for the search kriteria.
2. a ....... script or program (i could imagine a perl script) sorts all the search results of google for a more precisious result.
i think for no. 2 i have to find a solution with perl. because i heard, that perl is very vamouse in searching text documents.
but i have no idea how to solve the problem no.1. i was thinking to solve this task with something like a C++ applikation wich is running on a small server, but maybee it would work better with a solution of a cgi script or php wich is running on a webserver or somethin like this???
so, my problem is that i don't know enough about the possibilitys of the programming an scripting things. if there is a person who can give me a little input how to solve this tasks as easy as possible i would be verry happy.
thanks bluechip
can somebody tell me how i can make a webcrawler on my website wich is able to start requests on other search engines, for example with google.
how it should work:
i have a search function on my website. if somebody use this search funktion, my website should go to google (or other search engines) and asks there for the search kriteria. it should be able to check trough all the sites wich google is providing for this search criteria. then it should show the results from google, but in a better organized way then google does.
i think it should work something like this:
1. a ....... script or program should ask the google for the search kriteria.
2. a ....... script or program (i could imagine a perl script) sorts all the search results of google for a more precisious result.
i think for no. 2 i have to find a solution with perl. because i heard, that perl is very vamouse in searching text documents.
but i have no idea how to solve the problem no.1. i was thinking to solve this task with something like a C++ applikation wich is running on a small server, but maybee it would work better with a solution of a cgi script or php wich is running on a webserver or somethin like this???
so, my problem is that i don't know enough about the possibilitys of the programming an scripting things. if there is a person who can give me a little input how to solve this tasks as easy as possible i would be verry happy.
thanks bluechip