View Full Version : PHP Link Crawler

11-28-2006, 03:58 AM
Hi I am trying to build a Web Crawler in PHP I know how to parse text out of pages but I don't know how to crawl links. I have looked at scripts that do this but their big and even thow I can look at the code and try to figure it out, it's hard to know how it actually crawls the links. Can someone show me some code that crawls links and explain what part of the code does what or point me to some tutorials that teach you how to crawl links.