...

View Full Version : Web indexer language



Jacka
10-04-2007, 01:31 PM
I've been trying to make a web spider that grabs links from a site, then indexes them according to the domain, follows them, and repeats.

Eventually, I would like this to be a distributed project so many people can contribute to it.

I don't think a fancy GUI is neccessary.

Can anyone reccomend a language to use?

Dunna
10-04-2007, 06:57 PM
Java. Look here:
http://java.sun.com/developer/technicalArticles/ThirdParty/WebCrawler/

Jacka
10-04-2007, 08:04 PM
I want to make this program myself, not just use someone else's code.



EZ Archive Ads Plugin for vBulletin Copyright 2006 Computer Help Forum