11-24-2006, 12:27 AM
How when you parse links out of a page do you crawl them to the pages they link to and crawl those pages. How do you get the absolute domain when you crawl a page. Can someone explain to me in detail how to do this, code examples would be great. Could you also point me to some tutorials that teach you step by step how to a build a web crawler in PHP.