Web crawler - Java or PHP? need opinions

[cosminx2003]

Hi there,

I want to build a web crawler that should be able to search and crawl about 2.5 million times a day on Google, but i don't know what programming language should i use.
There would be easier to write it in PHP but it's a server-side language and i don't think it could handle huge amount of data without blocking. So i decided to write it in JAVA, actually i'm beginner but if i could make a crawler that is able to handle a huge amount of data then i am gonna learn it.

Ok, so what you think? :rolleyes:

[servlet]

Java would always be a better choice for crawlers.

[smoke10010]

Definitely java... a friend of mine is building linkvoodoo and they had issues trying to get PHP to crawl as efficiently as java. Java was just harder to learn

[rs_shadow0000]

Offers a single source to search the Web, images, video, news from Google, Yahoo!, MSN, Ask and many more search engines.


________________
Indianapolis seo (www.slingshotseo.com)