Jacka
10-04-2007, 12:31 PM
I've been trying to make a web spider that grabs links from a site, then indexes them according to the domain, follows them, and repeats.
Eventually, I would like this to be a distributed project so many people can contribute to it.
I don't think a fancy GUI is neccessary.
Can anyone reccomend a language to use?
Eventually, I would like this to be a distributed project so many people can contribute to it.
I don't think a fancy GUI is neccessary.
Can anyone reccomend a language to use?